00000001:02000400:1.0F:1787868417.918799:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787868437.630521:0:3513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787868439.891476:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 682 MB/s 00000001:01000000:1.0:1787868440.141486:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 515 MB/s 00000001:01000000:2.0:1787868440.391502:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3739 MB/s 00000020:02000000:1.0:1787868441.030415:0:3605:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_99_gb2219ab 00000400:02000000:0.0F:1787868442.096760:0:3620:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.127@tcp [8/256/0/180] 00008000:02000000:0.0:1787868446.429220:0:3770:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787868519.913359:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787868538.782433:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787868538.782441:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787868538.782443:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787868538.782581:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000938744a9 00000080:02000400:3.0:1787868538.782591:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787868538.805612:0:6489:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787868538.805628:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787868538.811289:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f6c8a9b8) 00000020:00000080:0.0:1787868538.811314:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787868538.898407:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787868538.898754:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787868538.929344:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787868538.929871:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787868538.929882:0:6489:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787868538.929897:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cb22 00000020:01000004:3.0:1787868538.929995:0:6489:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787868538.930003:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787868538.930009:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000938744a9 from MGS 00000020:01000004:3.0:1787868538.930015:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787868538.930039:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c6dce659) 00000020:00000080:3.0:1787868538.930054:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787868538.930204:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000938744a9 from MGS, refs=2 00080000:01000000:3.0:1787868538.930211:0:6489:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787868538.930217:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cb30 00000100:00100000:3.0:1787868538.930359:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787868538.930679:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787868538.930687:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787868538.934765:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787868538.934781:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787868538.935787:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787868538.936039:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787868538.936046:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787868538.941006:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787868538.941027:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787868538.948648:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787868538.948669:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787868538.949987:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868538.949993:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868538.949995:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868538.951024:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868538.951030:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868538.951032:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868538.953338:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787868538.969856:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787868539.202245:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2079 MB/s 00000001:01000000:3.0:1787868539.452455:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2571 MB/s 00000001:01000000:3.0:1787868539.703143:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 419 MB/s 00000001:01000000:0.0:1787868539.953469:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 495 MB/s 00080000:10000000:1.0:1787868539.967115:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1787868539.993229:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787868539.996920:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787868539.997516:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787868539.997583:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787868539.997865:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787868539.997891:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787868539.998445:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868539.998627:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787868539.998635:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787868540.000071:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787868540.000081:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787868540.000700:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787868540.000707:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787868540.001866:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787868540.001889:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:0.0:1787868540.001891:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787868540.002015:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:0.0:1787868540.002027:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (0000000026a743af) 00000020:00000080:0.0:1787868540.002044:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787868540.002125:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a4050bb1@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787868540.002322:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:0.0:1787868540.002329:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787868540.004797:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1787868540.006644:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787868540.014500:0:6510:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787868540.014630:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f) 00000020:00000080:1.0:1787868540.014657:0:6489:0:(genops.c:1385:class_connect()) connect: client 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f, cookie 0x2f11f4d3bde2cb3e 00000100:00080000:1.0:1787868540.014680:0:6489:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868540.014685:0:6489:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import 00000000a4050bb1 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868540.014723:0:6489:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000069c912e x1874715939438720/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868540.014864:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000069c912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939438720:0@lo:250: 00000100:00100000:3.0:1787868540.014948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868540.015008:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS 00000020:01000004:1.0:1787868540.015028:0:6489:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787868540.015050:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787868540.015072:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e49408ed) 00000020:00000080:1.0:1787868540.015085:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787868540.016466:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939438720 00000100:00100000:2.0:1787868540.016477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939438720 00000100:00100000:2.0:1787868540.016527:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868540.016534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056cc336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3635:x1874715939438720:12345-0@lo:250: 00010000:00080000:2.0:1787868540.016558:0:6505:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1787868540.016584:0:6505:0:(genops.c:1385:class_connect()) connect: client 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f, cookie 0x2f11f4d3bde2cb4c 00000100:00080000:2.0:1787868540.016731:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000409e991f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868540.025282:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056cc336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:3635:x1874715939438720:12345-0@lo:250: Request processed in 8739us (10326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.025298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868540.027512:0:3635:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787868540.027641:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1787868540.027652:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787868540.027657:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787868540.027660:0:3635:0:(import.c:65:import_set_state_nolock()) 00000000a4050bb1 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787868540.027664:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787868540.027684:0:3635:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787868540.027692:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000069c912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939438720:0@lo:250: 00000100:00100000:0.0:1787868540.037324:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787868540.037539:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787868540.037546:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787868540.038804:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787868540.038814:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787868540.039391:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868540.039400:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787868540.046293:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868540.046622:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787868540.046629:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787868540.048114:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787868540.048126:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787868540.095968:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868540.096272:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787868540.096278:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787868540.102603:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787868540.102629:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787868540.103911:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868540.104410:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868540.104418:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787868540.104966:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868540.104973:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787868540.105723:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868540.107534:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868540.107543:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787868540.111800:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868540.111829:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787868540.114350:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868540.114577:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868540.114583:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787868540.115721:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868540.115731:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787868540.135751:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868540.135964:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787868540.135971:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787868540.143481:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787868540.143497:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787868540.148022:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868540.148038:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787868540.150355:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787868540.150388:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787868540.150395:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787868540.150738:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787868540.150778:0:6489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787868540.150783:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787868540.150785:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868540.150786:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868540.150787:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787868540.150789:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868540.150790:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868540.150796:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868540.150797:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868540.150799:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787868540.150800:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787868540.150802:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868540.150803:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787868540.150805:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787868540.150807:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787868540.150808:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868540.150809:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868540.150810:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787868540.150810:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868540.150811:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868540.150812:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868540.150813:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868540.150814:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787868540.150815:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787868540.150815:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868540.150816:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787868540.150844:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787868540.150863:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000063328c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939438848:0@lo:253: 00000100:00100000:2.0:1787868540.150951:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.151124:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d886d5b going to sleep for 11 seconds 00000100:00100000:0.0:1787868540.151473:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939438848 00000100:00100000:0.0:1787868540.151480:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939438848 00000100:00100000:0.0:1787868540.151587:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868540.151597:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe29327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6489:x1874715939438848:12345-0@lo:253: 20000000:01000000:0.0:1787868540.151647:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787868540.151655:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787868540.152460:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787868540.152521:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787868540.152810:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868540.153970:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787868540.154213:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787868540.154217:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787868540.154222:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787868540.154226:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787868540.154237:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787868540.154434:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868540.154684:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787868540.154700:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787868540.154719:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787868540.154735:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787868540.154749:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787868540.154801:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787868540.154809:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787868540.154822:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787868540.154828:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787868540.154838:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787868540.154850:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787868540.154862:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787868540.154875:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787868540.154901:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787868540.154906:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787868540.154912:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868540.154997:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787868540.155006:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787868540.155021:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787868540.155033:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787868540.155048:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787868540.155055:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787868540.155091:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787868540.155100:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787868540.155110:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787868540.155132:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787868540.155147:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787868540.155181:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787868540.155208:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787868540.155216:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787868540.155229:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787868540.155244:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787868540.155311:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787868540.155333:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787868540.155340:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787868540.157331:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787868540.157695:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787868540.157726:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:1.0:1787868540.157729:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1787868540.157756:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787868540.157763:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787868540.157775:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787868540.157780:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1787868540.157791:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787868540.157798:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787868540.157809:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787868540.157822:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787868540.157856:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787868540.157859:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787868540.157863:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787868540.157911:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787868540.157914:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787868540.158643:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787868540.158838:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787868540.158857:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787868540.158871:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787868540.158878:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787868540.158880:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787868540.159316:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787868540.159461:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787868540.159480:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787868540.159494:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787868540.159503:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868540.159506:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787868540.159510:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787868540.159512:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787868540.159516:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787868540.159522:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787868540.159919:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787868540.160029:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787868540.169389:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787868540.169432:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787868540.169449:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787868540.169470:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787868540.169506:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169525:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169535:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169541:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169548:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169554:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169560:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b8b131ef already unused, calling callback (000000002ccb6f0c) 00010000:00010000:0.0:1787868540.169574:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169581:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169592:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169599:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.169604:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787868540.169635:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787868540.188397:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe29327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6489:x1874715939438848:12345-0@lo:253: Request processed in 36794us (37438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868540.188413:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868540.188743:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000063328c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939438848:0@lo:253: 10000000:01000000:2.0:1787868540.188772:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787868540.188776:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787868540.188779:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868540.188780:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868540.188782:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787868540.188783:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868540.188784:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868540.188785:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868540.188786:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868540.188788:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787868540.188806:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868540.188807:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787868540.188829:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000938744a9 from lustre-MDT0000 10000000:01000000:2.0:1787868540.188865:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787868540.188868:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787868540.188872:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93daae688000 10000000:01000000:2.0:1787868540.188876:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787868540.188896:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93daae688000 from 1 10000000:01000000:2.0:1787868540.188899:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787868540.188937:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.188947:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.188955:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.188973:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000063328c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939438976:0@lo:101: 00000100:00100000:2.0:1787868540.189010:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.189068:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004539d1b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787868540.189347:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939438976 00000100:00100000:0.0:1787868540.189354:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939438976 00000100:00100000:0.0:1787868540.189397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868540.189406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4fc552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6489:x1874715939438976:12345-0@lo:101: 00010000:00010000:0.0:1787868540.189418:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868540.189431:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cb5a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.189452:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.189461:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.189470:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8b131ef, rc 0) 00000100:00100000:0.0:1787868540.189513:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4fc552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:6489:x1874715939438976:12345-0@lo:101: Request processed in 108us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868540.189518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868540.189782:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000063328c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939438976:0@lo:101: 00010000:00010000:3.0:1787868540.189796:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.189804:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868540.189856:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439104:0@lo:501: 00000100:00100000:3.0:1787868540.189883:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.189911:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000407573b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787868540.189995:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439104 00000100:00100000:0.0:1787868540.189999:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439104 00000100:00100000:0.0:1787868540.190030:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787868540.190036:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c4a9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:6489:x1874715939439104:12345-0@lo:501: 00000100:00100000:0.0:1787868540.190415:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c4a9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:6489:x1874715939439104:12345-0@lo:501: Request processed in 379us (530us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787868540.190435:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868540.191059:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439104:0@lo:501: 10000000:01000000:3.0:1787868540.191092:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787868540.191639:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.191651:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868540.191689:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93daa05d8800 10000000:01000000:3.0:1787868540.191695:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787868540.191700:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93daa05d8800 10000000:01000000:3.0:1787868540.191702:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787868540.191705:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93daa05d8800 from 1 10000000:01000000:3.0:1787868540.191707:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787868540.191738:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.191745:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.191754:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868540.191781:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439232:0@lo:101: 00000100:00100000:3.0:1787868540.191841:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.192011:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000407573b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787868540.192093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439232 00000100:00100000:0.0:1787868540.192099:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439232 00000100:00100000:1.0:1787868540.192497:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868540.192507:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fa3b6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:6489:x1874715939439232:12345-0@lo:101: 00010000:00010000:1.0:1787868540.192520:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868540.192537:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eab841d0/0x2f11f4d3bde2cb6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cb68 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.192558:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eab841d0/0x2f11f4d3bde2cb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb68 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.192567:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eab841d0/0x2f11f4d3bde2cb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb68 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.192574:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eab841d0, rc 0) 00000100:00100000:1.0:1787868540.192683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fa3b6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+7:6489:x1874715939439232:12345-0@lo:101: Request processed in 178us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.192690:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868540.192836:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439232:0@lo:101: 00010000:00010000:3.0:1787868540.192850:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.192857:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868540.192872:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787868540.192893:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.192912:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000002a34a9e3/0x2f11f4d3bde2cb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868540.192920:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787868540.192924:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787868540.192929:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93daa05d8800 10000000:01000000:3.0:1787868540.193598:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787868540.193606:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787868540.193608:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787868540.193641:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.193649:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.193656:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868540.193686:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439360:0@lo:101: 00000100:00100000:3.0:1787868540.193728:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.194027:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000407573b2 going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.194267:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439360 00000100:00100000:1.0:1787868540.194285:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439360 00000100:00100000:1.0:1787868540.194329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868540.194336:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ccfb93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+7:6489:x1874715939439360:12345-0@lo:101: 00010000:00010000:1.0:1787868540.194346:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868540.194356:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cb76 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.194377:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.194386:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.194393:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ab1c59c, rc 0) 00000100:00100000:1.0:1787868540.194439:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ccfb93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+8:6489:x1874715939439360:12345-0@lo:101: Request processed in 104us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.194445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787868540.194533:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439360:0@lo:101: 00010000:00010000:3.0:1787868540.194545:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.194552:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868540.194624:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439488:0@lo:501: 00000100:00100000:3.0:1787868540.194651:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.194688:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000407573b2 going to sleep for 11 seconds 00000100:00100000:2.0:1787868540.194896:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439488 00000100:00100000:2.0:1787868540.194901:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439488 00000100:00100000:2.0:1787868540.194924:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787868540.194930:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004909d3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+8:6489:x1874715939439488:12345-0@lo:501: 00000100:00100000:2.0:1787868540.195074:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004909d3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6489:x1874715939439488:12345-0@lo:501: Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.195081:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868540.195412:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439488:0@lo:501: 00000100:00100000:3.0:1787868540.195454:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439616:0@lo:503: 00000100:00100000:3.0:1787868540.195494:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.195520:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000407573b2 going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.195575:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439616 00000100:00100000:1.0:1787868540.195580:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439616 00000100:00100000:1.0:1787868540.195610:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868540.195616:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4008363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6489:x1874715939439616:12345-0@lo:503: 00000100:00100000:1.0:1787868540.195746:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4008363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6489:x1874715939439616:12345-0@lo:503: Request processed in 130us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.195753:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787868540.196266:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939439616:0@lo:503: 00000100:00100000:0.0:1787868540.200213:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e09be352 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6534:1874715939439744:0@lo:502: 00000100:00100000:0.0:1787868540.200341:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868540.200439:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cde3ff34 going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.202518:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439744 00000100:00100000:1.0:1787868540.202537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439744 00000100:00100000:1.0:1787868540.202756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868540.202840:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063c74341 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6534:x1874715939439744:12345-0@lo:502: 00000100:00100000:1.0:1787868540.203294:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063c74341 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6534:x1874715939439744:12345-0@lo:502: Request processed in 457us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.203309:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787868540.203464:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e09be352 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6534:1874715939439744:0@lo:502: 00000020:01000000:0.0:1787868540.203500:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868540.203512:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868540.203515:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787868540.203519:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787868540.203523:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868540.203539:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005107a9d8) 00000020:00000080:0.0:1787868540.203558:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787868540.203564:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787868540.203661:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787868540.203681:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cb8b 00000020:00000080:0.0:1787868540.204098:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787868540.204103:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868540.204107:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868540.204108:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787868540.204111:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868540.204115:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868540.204116:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787868540.204119:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868540.204125:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046442c78) 00000020:00000080:0.0:1787868540.204135:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787868540.204139:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787868540.204141:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787868540.204143:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787868540.204506:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787868540.204578:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000938744a9 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787868540.204593:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ee40a625) 00000020:00000080:1.0:1787868540.204601:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787868540.204689:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787868540.204695:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2cba0 00000020:00000080:1.0:1787868540.204865:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787868540.204873:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787868540.204878:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f11f4d3bde2cba7 00080000:01000000:1.0:1787868540.204983:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787868540.204989:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cbae 00080000:10000000:1.0:1787868540.205621:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787868540.205998:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787868540.213647:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787868540.309736:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787868540.310385:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787868540.317463:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787868540.319026:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787868540.335589:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001374ff6e) 00000020:00000080:2.0:1787868540.335623:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787868540.336563:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787868540.336581:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cbbc 00000020:00000080:3.0:1787868540.337799:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787868540.338848:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787868540.351381:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787868540.360530:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787868540.370677:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787868540.377441:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787868540.384932:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787868540.393292:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f11f4d3bde2cbc3 00000020:00000080:1.0:1787868540.393589:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787868540.393604:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868540.393611:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868540.393613:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787868540.393616:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868540.393620:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868540.393622:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787868540.393625:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787868540.393626:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787868540.393629:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868540.393632:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868540.393633:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787868540.393635:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868540.393646:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868540.393648:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787868540.393652:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787868540.393710:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787868540.393783:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042ea368f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6534:1874715939439872:0@lo:502: 00000100:00100000:1.0:1787868540.393889:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868540.393961:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfcdf691 going to sleep for 11 seconds 00000100:00100000:2.0:1787868540.395245:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939439872 00000100:00100000:2.0:1787868540.395263:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939439872 00000100:00100000:2.0:1787868540.395335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868540.395345:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740f06c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6534:x1874715939439872:12345-0@lo:502: 00000100:00100000:2.0:1787868540.395546:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740f06c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6534:x1874715939439872:12345-0@lo:502: Request processed in 200us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.395554:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787868540.395740:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042ea368f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6534:1874715939439872:0@lo:502: 00000020:01000000:1.0:1787868540.395783:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868540.395792:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868540.395796:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787868540.395800:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787868540.397478:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787868540.397524:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787868540.397546:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.397561:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868540.397571:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05d8800 from 1 10000000:01000000:2.0:1787868540.397574:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868540.397625:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.397633:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.397644:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.397684:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440000:0@lo:101: 00000100:00100000:2.0:1787868540.397793:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.397841:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5347e1e going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.398460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440000 00000100:00100000:1.0:1787868540.398472:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440000 00000100:00100000:1.0:1787868540.398539:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787868540.398550:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4cc7913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:6489:x1874715939440000:12345-0@lo:101: 00010000:00010000:1.0:1787868540.398567:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868540.398585:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cbca expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.398615:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.398625:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.398634:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4320dad, rc 0) 00000100:00100000:1.0:1787868540.398707:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4cc7913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:6489:x1874715939440000:12345-0@lo:101: Request processed in 160us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.398731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868540.398858:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440000:0@lo:101: 00010000:00010000:2.0:1787868540.398876:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.398885:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.400846:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440128:0@lo:256: 00000100:00100000:2.0:1787868540.400952:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.401019:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5347e1e going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.401349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440128 00000100:00100000:1.0:1787868540.401360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440128 00000100:00100000:1.0:1787868540.401421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868540.401431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3556874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:6489:x1874715939440128:12345-0@lo:256: 20000000:01000000:1.0:1787868540.401458:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787868540.401466:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787868540.401561:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3556874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:6489:x1874715939440128:12345-0@lo:256: Request processed in 131us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.401569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868540.402258:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440128:0@lo:256: 10000000:01000000:0.0:1787868540.404741:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787868540.405146:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868540.405186:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868540.405360:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05d8800 from 1 10000000:01000000:1.0:1787868540.405365:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868540.405434:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.405443:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.405456:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868540.405485:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042ea368f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440256:0@lo:101: 00000100:00100000:1.0:1787868540.405574:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868540.405635:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000009909ea68 going to sleep for 11 seconds 00000100:00100000:2.0:1787868540.406209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440256 00000100:00100000:2.0:1787868540.406221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440256 00000100:00100000:2.0:1787868540.406291:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868540.406302:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008be117c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:6489:x1874715939440256:12345-0@lo:101: 00010000:00010000:2.0:1787868540.406320:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868540.406343:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cbd8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.406375:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.406388:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.406398:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ccbb09a, rc 0) 00000100:00100000:2.0:1787868540.406544:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008be117c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440256:12345-0@lo:101: Request processed in 244us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.406574:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868540.414307:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042ea368f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440256:0@lo:101: 00010000:00010000:3.0:1787868540.414357:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.414373:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.414685:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440384:0@lo:501: 00000100:00100000:2.0:1787868540.414789:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.414860:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c2a858f going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.415028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440384 00000100:00100000:1.0:1787868540.415037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440384 00000100:00100000:1.0:1787868540.415101:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868540.415112:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f3c5cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440384:12345-0@lo:501: 00000100:00100000:1.0:1787868540.415381:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f3c5cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440384:12345-0@lo:501: Request processed in 271us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.415390:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787868540.415691:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440384:0@lo:501: 00000100:00100000:3.0:1787868540.415736:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440512:0@lo:503: 00000100:00100000:3.0:1787868540.415798:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868540.415830:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000003eafd4d3 going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.415960:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440512 00000100:00100000:1.0:1787868540.415966:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440512 00000100:00100000:1.0:1787868540.416009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868540.416019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d21261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440512:12345-0@lo:503: 00000040:00080000:1.0:1787868540.416070:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868540.416121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d21261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440512:12345-0@lo:503: Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.416128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868540.416334:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440512:0@lo:503: 00000040:00080000:3.0:1787868540.418141:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787868540.421420:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787868540.421480:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787868540.421510:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.421528:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868540.421650:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787868540.421655:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93daa05d8800 10000000:01000000:2.0:1787868540.421658:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93daa05d8800 10000000:01000000:2.0:1787868540.421675:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787868540.421683:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05d8800 from 1 10000000:01000000:2.0:1787868540.421686:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787868540.421738:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.421747:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.424212:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.424274:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440640:0@lo:101: 00000100:00100000:2.0:1787868540.424378:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.424477:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ebc5d4a going to sleep for 11 seconds 00000100:00100000:3.0:1787868540.424691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440640 00000100:00100000:3.0:1787868540.424703:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440640 00000100:00100000:3.0:1787868540.424775:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868540.424784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c307276c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6489:x1874715939440640:12345-0@lo:101: 00010000:00010000:3.0:1787868540.424802:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868540.424827:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cbe6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.424859:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.424873:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.424885:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4fb989e, rc 0) 00000100:00100000:3.0:1787868540.424931:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c307276c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939440640:12345-0@lo:101: Request processed in 148us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868540.424938:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868540.425301:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440640:0@lo:101: 00010000:00010000:2.0:1787868540.425321:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.425331:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.425422:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440768:0@lo:501: 00000100:00100000:2.0:1787868540.425455:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.425493:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ebc5d4a going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.425556:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440768 00000100:00100000:1.0:1787868540.425563:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440768 00000100:00100000:1.0:1787868540.425603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868540.425611:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e2bf2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939440768:12345-0@lo:501: 00000100:00100000:1.0:1787868540.425798:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e2bf2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939440768:12345-0@lo:501: Request processed in 188us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.425806:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868540.425955:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440768:0@lo:501: 00000100:00100000:2.0:1787868540.425985:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440896:0@lo:503: 00000100:00100000:2.0:1787868540.426033:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.426063:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ebc5d4a going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.426207:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939440896 00000100:00100000:1.0:1787868540.426212:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939440896 00000100:00100000:1.0:1787868540.426237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868540.426243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8790083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939440896:12345-0@lo:503: 00000100:00100000:1.0:1787868540.426330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8790083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939440896:12345-0@lo:503: Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.426337:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787868540.426420:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939440896:0@lo:503: 00000100:00100000:2.0:1787868540.426880:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000628ac71e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6539:1874715939441024:0@lo:502: 00000100:00100000:2.0:1787868540.426919:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.426989:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032fe6cbd going to sleep for 11 seconds 00000100:00100000:3.0:1787868540.429892:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441024 00000100:00100000:3.0:1787868540.429916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441024 00000100:00100000:2.0:1787868540.434050:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787868540.434081:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f799384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6539:x1874715939441024:12345-0@lo:502: 00000100:00100000:2.0:1787868540.434368:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f799384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6539:x1874715939441024:12345-0@lo:502: Request processed in 292us (7448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.434377:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787868540.434513:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000628ac71e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6539:1874715939441024:0@lo:502: 00000020:01000004:3.0:1787868540.434605:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787868540.434631:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004e465d86) 00000020:00000080:3.0:1787868540.434672:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787868540.434835:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000938744a9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787868540.434846:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000938744a9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787868540.434850:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000938744a9 4 00010000:00080000:3.0:1787868540.434893:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000011e9a0d1@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868540.436613:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787868540.436887:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787868540.436936:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787868540.436953:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f11f4d3bde2cbfb 00000100:00080000:3.0:1787868540.436966:0:6539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868540.436974:0:6539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000011e9a0d1 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868540.437019:0:6539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a666a1e x1874715939441152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868540.437081:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939441152:0@lo:38: 00000100:00100000:3.0:1787868540.437204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787868540.437296:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787868540.445380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441152 00000100:00100000:1.0:1787868540.445404:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441152 00000100:00100000:1.0:1787868540.445498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868540.445507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7804936 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939441152:12345-0@lo:38: 00000100:00100000:1.0:1787868540.445654:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7804936 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939441152:12345-0@lo:38: Request processed in 147us (8450us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787868540.445675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868540.446882:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868540.446897:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000011e9a0d1 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868540.446924:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787868540.446930:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a666a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939441152:0@lo:38: 00000100:00100000:2.0:1787868540.451348:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6539:1874715939441280:0@lo:502: 00000100:00100000:2.0:1787868540.451468:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.451527:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441280 00000100:00100000:2.0:1787868540.451543:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441280 00000100:00100000:2.0:1787868540.451601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787868540.451611:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bde26662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6539:x1874715939441280:12345-0@lo:502: 00000100:00100000:3.0:1787868540.453268:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dec7a50c going to sleep for 11 seconds 00000100:00100000:2.0:1787868540.453419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bde26662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6539:x1874715939441280:12345-0@lo:502: Request processed in 1807us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.453431:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787868540.464480:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6539:1874715939441280:0@lo:502: 00000040:00080000:3.0:1787868540.464652:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787868540.464877:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787868540.464909:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787868540.464941:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.464956:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787868540.465039:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787868540.465043:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868540.465044:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868540.465045:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787868540.465046:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868540.465048:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868540.465050:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868540.465051:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868540.465053:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787868540.465066:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787868540.465069:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868540.465071:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787868540.465076:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787868540.465079:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787868540.465080:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868540.465081:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868540.465082:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787868540.465083:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868540.465084:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868540.465085:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868540.465086:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868540.465094:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787868540.465095:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787868540.465096:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868540.465096:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787868540.465128:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787868540.465147:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bf9825b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939441408:0@lo:253: 00000100:00100000:2.0:1787868540.465469:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.465522:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d886d5b going to sleep for 11 seconds 00000100:00100000:0.0:1787868540.465571:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441408 00000100:00100000:0.0:1787868540.465580:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441408 00000100:00100000:0.0:1787868540.465638:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868540.465647:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b1e060c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939441408:12345-0@lo:253: 20000000:01000000:0.0:1787868540.465689:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787868540.465705:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787868540.476052:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787868540.476091:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787868540.476128:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787868540.476135:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787868540.476199:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.476226:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.476243:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.476396:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.476417:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.476435:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939441536:0@lo:104: 00000100:00100000:2.0:1787868540.476532:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.476606:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054f1ca9f going to sleep for 11 seconds 00000100:00100000:1.0:1787868540.476693:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441536 00000100:00100000:1.0:1787868540.476704:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441536 00000100:00100000:1.0:1787868540.476783:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868540.476793:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b34d27c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939441536:12345-0@lo:104: 00010000:00010000:1.0:1787868540.476808:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868540.476893:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868540.476899:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b34d27c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939441536:12345-0@lo:104: Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868540.476907:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787868540.476964:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868540.476987:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.476995:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000018e40c37 already unused, calling callback (00000000f6284d2a) 10000000:00010000:3.0:1787868540.477000:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.477008:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868540.477014:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868540.477019:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787868540.477070:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868540.477076:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939441536:0@lo:104: 00010000:00010000:3.0:1787868540.477080:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868540.477103:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868540.477110:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.477111:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000018e40c37/0x2f11f4d3bde2cbca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.477144:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868540.477146:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868540.477148:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868540.477544:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939441664:0@lo:103: 00000100:00100000:0.0:1787868540.477592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868540.477762:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b1e060c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6489:x1874715939441408:12345-0@lo:253: Request processed in 12107us (12286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868540.477778:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868540.477908:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441664 00000100:00100000:3.0:1787868540.477915:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441664 00010000:00010000:3.0:1787868540.477941:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868540.478000:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868540.478009:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e09be352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3637:x1874715939441664:12345-0@lo:103: 00010000:00010000:3.0:1787868540.478024:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868540.478029:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478049:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478066:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cbd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbca expref: 12 pid: 6505 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478084:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478092:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868540.478100:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bf9825b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6489:1874715939441408:0@lo:253: 20000000:01000000:3.0:1787868540.478111:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001977246s 10000000:01000000:0.0:1787868540.478115:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:3.0:1787868540.478117:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868540.478120:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868540.478124:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787868540.478127:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868540.478130:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1787868540.478133:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868540.478133:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868540.478136:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868540.478139:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787868540.478142:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00010000:00010000:3.0:1787868540.478145:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868540.478151:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00010000:00010000:3.0:1787868540.478179:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478192:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000065167cc already unused, calling callback (000000002ccb6f0c) 00010000:00010000:3.0:1787868540.478197:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868540.478197:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868540.478201:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868540.478204:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1787868540.478211:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1787868540.478220:0:6489:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787868540.478230:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478601:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868540.478650:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e09be352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:3637:x1874715939441664:12345-0@lo:103: Request processed in 644us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868540.478658:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868540.478703:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939441664:0@lo:103: 00010000:00010000:3.0:1787868540.478722:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478730:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868540.478736:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000065167cc/0x2f11f4d3bde2cc02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787868540.495079:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787868540.495496:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787868540.497524:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787868540.500075:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787868540.501880:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787868540.502071:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787868540.519733:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787868540.524982:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787868540.525739:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787868540.526397:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787868540.526638:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787868540.527479:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787868540.532138:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787868540.542628:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787868540.543051:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787868540.545284:0:6544:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787868540.545299:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787868540.545422:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787868540.545556:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787868540.546142:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787868540.546473:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787868540.546684:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868540.548223:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787868540.548805:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787868540.548845:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787868540.552015:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868540.552855:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787868540.554395:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:2.0:1787868540.558212:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787868540.558336:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787868540.558342:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1787868540.559635:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787868540.559926:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787868540.560443:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787868540.560600:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787868540.560751:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787868540.561025:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787868540.561520:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787868540.561686:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787868540.561914:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787868540.562377:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787868540.562560:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787868540.562733:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787868540.562958:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787868540.563412:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787868540.563596:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787868540.563747:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787868540.564507:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787868540.564719:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787868540.564938:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787868540.565376:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787868540.565504:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787868540.565633:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787868540.565968:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787868540.566490:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787868540.566617:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787868540.566838:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787868540.566982:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787868540.567521:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787868540.567697:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787868540.568650:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787868540.568946:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787868540.569549:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787868540.569898:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787868540.575096:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787868540.575188:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3fe419a7988 00100000:10000000:0.0:1787868540.575200:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787868540.576569:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787868540.576596:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787868540.576621:0:6489:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787868540.576644:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787868540.579907:0:6489:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868540.580302:0:6489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787868541.025436:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868542.050180:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868543.075302:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868544.098370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868545.128139:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787868545.826397:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787868545.826408:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787868545.826411:0:37:0:(import.c:65:import_set_state_nolock()) 0000000011e9a0d1 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868545.826425:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000011e9a0d1 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868545.826448:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003699b42c x1874715939441920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868545.826483:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003699b42c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939441920:0@lo:38: 00000100:00100000:2.0:1787868545.826569:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868545.826655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441920 00000100:00100000:2.0:1787868545.826664:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441920 00000100:00100000:2.0:1787868545.826695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868545.826701:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bf9825b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939441920:12345-0@lo:38: 00010000:00080000:2.0:1787868545.826725:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1787868545.826759:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f11f4d3bde2cc09 00000004:00100000:2.0:1787868545.826800:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787868545.826909:0:6514:0:(import.c:65:import_set_state_nolock()) 0000000053c61ab3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868545.826958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bf9825b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874715939441920:12345-0@lo:38: Request processed in 256us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868545.826967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787868545.827006:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003699b42c x1874715939441920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787868545.827021:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787868545.827037:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787868545.827040:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787868545.827043:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000011e9a0d1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787868545.827047:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003699b42c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939441920:0@lo:38: 00000100:00100000:0.0:1787868545.830771:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939441792:0@lo:400: 00000100:00100000:0.0:1787868545.830853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868545.830982:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939441792 00000100:00100000:0.0:1787868545.830990:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939441792 00000100:00100000:0.0:1787868545.831039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787868545.831048:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e822148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:3638:x1874715939441792:12345-0@lo:400: 00000100:00100000:0.0:1787868545.831101:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e822148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:3638:x1874715939441792:12345-0@lo:400: Request processed in 55us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868545.831109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787868545.831171:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939441792:0@lo:400: 00000001:02000400:2.0:1787868546.116440:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787868546.147622:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787868546.849824:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787868546.849832:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05d8800 from 3 10000000:01000000:2.0:1787868546.849838:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868546.849885:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868546.849898:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868546.849908:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868546.849933:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003699b42c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939442048:0@lo:101: 00000100:00100000:2.0:1787868546.850004:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868546.850073:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000600da217 going to sleep for 11 seconds 00000100:00100000:0.0:1787868546.850089:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442048 00000100:00100000:0.0:1787868546.850098:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442048 00000100:00100000:0.0:1787868546.850187:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787868546.850197:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea181e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:6510:x1874715939442048:12345-0@lo:101: 00010000:00010000:0.0:1787868546.850215:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868546.850231:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cc10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868546.850256:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868546.850265:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868546.850275:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4b2a760, rc 0) 00000100:00100000:0.0:1787868546.850318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea181e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6510:x1874715939442048:12345-0@lo:101: Request processed in 123us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868546.850326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787868546.850437:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003699b42c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939442048:0@lo:101: 00010000:00010000:1.0:1787868546.850451:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868546.850469:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868546.850549:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939442176:0@lo:256: 00000100:00100000:1.0:1787868546.850582:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868546.850611:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e2971c4 going to sleep for 11 seconds 00000100:00100000:0.0:1787868546.850664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442176 00000100:00100000:0.0:1787868546.850669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442176 00000100:00100000:0.0:1787868546.850701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787868546.850708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5aedbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6510:x1874715939442176:12345-0@lo:256: 20000000:01000000:0.0:1787868546.850721:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787868546.850736:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787868546.850739:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787868546.850826:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5aedbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:6510:x1874715939442176:12345-0@lo:256: Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868546.850833:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787868546.851196:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939442176:0@lo:256: 10000000:01000000:1.0:1787868546.851239:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787868546.851246:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868546.851254:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868547.169379:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868547.441929:0:6842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868547.442694:0:6842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868548.193289:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868549.217545:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868550.241535:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787868550.373089:0:6943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868550.373407:0:6943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787868550.945571:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d89cc09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939442304:0@lo:400: 00000100:00100000:2.0:1787868550.945661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868550.946308:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442304 00000100:00100000:0.0:1787868550.946318:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442304 00000100:00100000:0.0:1787868550.946380:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868550.946389:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a336fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3639:x1874715939442304:12345-0@lo:400: 00000100:00100000:3.0:1787868550.946701:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868550.946714:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd9ec465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939442432:0@lo:400: 00000100:00100000:3.0:1787868550.946748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868550.947383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442432 00000100:00100000:1.0:1787868550.947390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442432 00000100:00100000:1.0:1787868550.947428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868550.947435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064243eb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939442432:12345-0@lo:400: 00000100:00100000:1.0:1787868550.947499:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064243eb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939442432:12345-0@lo:400: Request processed in 64us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868550.947507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787868550.947544:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fd9ec465 x1874715939442432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868550.947557:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd9ec465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939442432:0@lo:400: 00000100:00100000:0.0:1787868550.950075:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a336fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3639:x1874715939442304:12345-0@lo:400: Request processed in 3680us (4406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868550.950090:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868550.956100:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d89cc09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939442304:0@lo:400: 00010000:00010000:3.0:1787868551.265805:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868552.303300:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868553.337152:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868554.338566:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868555.362048:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868556.065649:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868556.065702:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c009a619 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939442560:0@lo:400: 00000100:00100000:2.0:1787868556.065811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868556.065895:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868556.065917:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7323e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939442688:0@lo:400: 00000100:00100000:2.0:1787868556.065954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868556.065994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442688 00000100:00100000:2.0:1787868556.066015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442688 00000100:00100000:2.0:1787868556.066079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868556.066089:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000063328c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939442688:12345-0@lo:400: 00000100:00100000:2.0:1787868556.066151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000063328c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939442688:12345-0@lo:400: Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868556.066185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787868556.066238:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005a7323e3 x1874715939442688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868556.066254:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7323e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939442688:0@lo:400: 00000100:00100000:1.0:1787868556.066731:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442560 00000100:00100000:1.0:1787868556.066762:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442560 00000100:00100000:1.0:1787868556.066810:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787868556.066818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd7d9037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3636:x1874715939442560:12345-0@lo:400: 00000100:00100000:1.0:1787868556.066879:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd7d9037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3636:x1874715939442560:12345-0@lo:400: Request processed in 63us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868556.066886:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787868556.067136:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c009a619 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939442560:0@lo:400: 00010000:00010000:2.0:1787868556.385497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868557.415393:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868558.441392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868559.459135:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868560.493803:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868561.092554:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787868561.092559:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787868561.092561:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787868561.093019:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000010d1adf2 00000020:01000004:3.0:1787868561.093036:0:7442:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1787868561.093046:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787868561.093059:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000bc118b87) 00000020:00000080:3.0:1787868561.093072:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787868561.167005:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787868561.167079:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00000100:00100000:3.0:1787868561.187770:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868561.187797:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939442944:0@lo:400: 00000100:00100000:3.0:1787868561.187865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.187930:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442944 00000100:00100000:1.0:1787868561.187939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442944 00000100:00100000:1.0:1787868561.188008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868561.188020:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1db29c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939442944:12345-0@lo:400: 00000100:00100000:3.0:1787868561.188202:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000382d1d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939442816:0@lo:400: 00000100:00100000:1.0:1787868561.188205:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1db29c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939442944:12345-0@lo:400: Request processed in 187us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.188217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868561.188244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.188282:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939442816 00000100:00100000:1.0:1787868561.188287:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939442816 00000100:00100000:1.0:1787868561.188319:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868561.188327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eedb6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3639:x1874715939442816:12345-0@lo:400: 00010000:00080000:3.0:1787868561.188331:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c09157d9 x1874715939442944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868561.188348:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939442944:0@lo:400: 00000100:00100000:1.0:1787868561.188384:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eedb6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3639:x1874715939442816:12345-0@lo:400: Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.188391:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868561.188441:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000382d1d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939442816:0@lo:400: 00080000:01000000:3.0:1787868561.201928:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787868561.202206:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787868561.202218:0:7442:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787868561.202230:0:7442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2cc25 00000020:01000004:3.0:1787868561.202237:0:7442:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787868561.202258:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787868561.202273:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787868561.202279:0:7442:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787868561.202506:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787868561.202511:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787868561.233901:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787868561.233942:0:7442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787868561.233947:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787868561.233948:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868561.233950:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868561.233951:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868561.233952:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868561.233953:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868561.233954:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868561.233956:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787868561.233957:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787868561.233958:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868561.233960:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787868561.233964:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787868561.233966:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787868561.233967:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868561.233968:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868561.233974:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868561.233975:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868561.233976:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868561.233976:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868561.233977:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787868561.233978:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787868561.233978:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868561.233979:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787868561.234018:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787868561.234037:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939443072:0@lo:253: 00000100:00100000:3.0:1787868561.234111:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.234247:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be6e9321 going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.234473:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443072 00000100:00100000:2.0:1787868561.234482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443072 00000100:00100000:2.0:1787868561.234569:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868561.234577:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000888bce4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939443072:12345-0@lo:253: 20000000:01000000:2.0:1787868561.234609:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787868561.234614:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787868561.234620:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787868561.234624:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787868561.234665:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787868561.234844:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787868561.234972:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787868561.234983:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787868561.234997:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787868561.235012:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787868561.235025:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787868561.235071:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787868561.235077:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787868561.235088:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787868561.235093:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787868561.235102:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787868561.235106:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787868561.235118:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787868561.235130:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787868561.235576:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787868561.235587:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:2.0:1787868561.235599:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787868561.235604:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787868561.235616:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787868561.235621:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:2.0:1787868561.235632:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787868561.235637:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787868561.235647:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787868561.235661:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787868561.235670:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787868561.235743:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787868561.235752:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787868561.235765:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787868561.235781:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787868561.235796:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787868561.235811:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1787868561.235827:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787868561.235847:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787868561.235852:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1787868561.235875:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787868561.235882:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787868561.236370:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787868561.236611:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787868561.236633:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:3.0:1787868561.236635:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:3.0:1787868561.236652:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787868561.236658:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787868561.236671:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787868561.236676:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:3.0:1787868561.236692:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787868561.236699:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1787868561.236711:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1787868561.236725:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1787868561.236773:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1787868561.236781:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787868561.237074:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787868561.237351:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787868561.237434:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:2.0:1787868561.237436:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:2.0:1787868561.237453:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787868561.237459:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787868561.237471:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787868561.237476:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:2.0:1787868561.237487:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787868561.237492:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787868561.237504:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787868561.237516:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787868561.237534:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787868561.237537:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787868561.237540:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787868561.237587:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787868561.237588:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868561.237959:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868561.237979:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868561.237996:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787868561.238152:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787868561.240859:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787868561.240889:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787868561.240908:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787868561.240910:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787868561.241702:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787868561.241728:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787868561.241744:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787868561.241943:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787868561.241962:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787868561.241973:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787868561.241981:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787868561.241983:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787868561.242643:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787868561.242666:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787868561.242680:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787868561.243776:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787868561.243819:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787868561.243837:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787868561.243853:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787868561.243856:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787868561.243862:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787868561.243868:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787868561.245875:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787868561.246035:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787868561.260337:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787868561.260938:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.260958:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.260965:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.260971:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.260977:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.261015:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.261029:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.261041:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c322dc6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443200:0@lo:104: 00000100:00100000:0.0:1787868561.261493:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868561.261552:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.261560:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 12 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.261568:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443328:0@lo:104: 00000100:00100000:0.0:1787868561.261589:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868561.261610:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.261617:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.261624:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443456:0@lo:104: 00000100:00100000:0.0:1787868561.261642:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.261652:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4d41c0a going to sleep for 11 seconds 00000100:00100000:1.0:1787868561.261714:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443200 00000100:00100000:1.0:1787868561.261721:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443200 00000100:00100000:1.0:1787868561.261756:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443328 00000100:00100000:1.0:1787868561.261759:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443328 00000100:00100000:1.0:1787868561.261769:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443456 00000100:00100000:1.0:1787868561.261771:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443456 00000100:00100000:1.0:1787868561.261784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868561.261799:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb954b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6505:x1874715939443200:12345-0@lo:104: 00010000:00010000:1.0:1787868561.261811:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.261871:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868561.261876:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb954b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6505:x1874715939443200:12345-0@lo:104: Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.261882:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868561.261899:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868561.261904:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74ec03e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6505:x1874715939443328:12345-0@lo:104: 00010000:00010000:1.0:1787868561.261909:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.261938:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787868561.261941:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74ec03e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6505:x1874715939443328:12345-0@lo:104: Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.261946:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868561.261955:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868561.261960:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0acc516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6505:x1874715939443456:12345-0@lo:104: 00010000:00010000:1.0:1787868561.261964:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262000:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787868561.262004:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0acc516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6505:x1874715939443456:12345-0@lo:104: Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.262010:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787868561.262024:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787868561.262028:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262040:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000085fb18b5 already unused, calling callback (00000000f6284d2a) 10000000:00010000:1.0:1787868561.262043:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262050:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868561.262055:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868561.262060:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868561.262088:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262094:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868561.262123:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262129:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000085fb18b5/0x2f11f4d3bde2cbe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262140:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787868561.262142:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262148:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5749e8d already unused, calling callback (00000000f6284d2a) 10000000:00010000:1.0:1787868561.262149:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262198:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868561.262211:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868561.262216:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868561.262230:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262236:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868561.262249:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262255:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000c5749e8d/0x2f11f4d3bde2cb76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb7d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262275:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868561.262277:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262283:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000082e59bc3 already unused, calling callback (00000000f6284d2a) 10000000:00010000:1.0:1787868561.262285:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262291:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868561.262296:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868561.262307:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868561.262320:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262326:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868561.262329:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262335:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cb5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cb61 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262346:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868561.262347:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868561.262349:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868561.262367:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868561.262384:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939443584:0@lo:103: 00000100:00100000:1.0:1787868561.262411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.262441:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939443840:0@lo:103: 00000100:00100000:1.0:1787868561.262462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.262477:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868561.262481:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939443712:0@lo:103: 00000100:00100000:1.0:1787868561.262501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.262524:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443584 00000100:00100000:1.0:1787868561.262528:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443584 00010000:00010000:1.0:1787868561.262545:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 13 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868561.262558:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443840 00000100:00100000:1.0:1787868561.262566:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443840 00010000:00010000:1.0:1787868561.262575:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868561.262584:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443712 00000100:00100000:1.0:1787868561.262586:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443712 00010000:00010000:1.0:1787868561.262592:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 15 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868561.262602:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868561.262606:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9034acf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939443584:12345-0@lo:103: 00010000:00010000:1.0:1787868561.262615:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868561.262620:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 15 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262628:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 15 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262642:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868561.262669:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9034acf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939443584:12345-0@lo:103: Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.262675:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868561.262687:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868561.262692:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ea368f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3639:x1874715939443840:12345-0@lo:103: 00010000:00010000:1.0:1787868561.262699:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868561.262702:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262708:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262727:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868561.262752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ea368f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3639:x1874715939443840:12345-0@lo:103: Request processed in 61us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.262758:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868561.262769:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868561.262774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000069c912e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3639:x1874715939443712:12345-0@lo:103: 00010000:00010000:1.0:1787868561.262781:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868561.262784:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 13 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262791:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 13 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262801:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262807:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262819:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262825:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262831:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262837:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262847:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ecb2717 already unused, calling callback (000000002ccb6f0c) 00010000:00010000:1.0:1787868561.262851:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262858:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262865:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.262874:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868561.262893:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000069c912e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3639:x1874715939443712:12345-0@lo:103: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.262898:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868561.262930:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939443584:0@lo:103: 00000100:00100000:1.0:1787868561.262961:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939443712:0@lo:103: 00000100:00100000:1.0:1787868561.262967:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939443840:0@lo:103: 00010000:00010000:0.0:1787868561.263462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4fb989e/0x2f11f4d3bde2cbed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbe6 expref: 12 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.263475:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c322dc6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443200:0@lo:104: 00010000:00010000:0.0:1787868561.263483:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cb7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb76 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.263490:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443328:0@lo:104: 00010000:00010000:0.0:1787868561.263498:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2cb61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cb5a expref: 10 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.263506:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874715939443456:0@lo:104: 00010000:00010000:0.0:1787868561.263528:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.263541:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.263546:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.263551:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ecb2717/0x2f11f4d3bde2cc2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787868561.263566:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787868561.272126:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000888bce4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:7442:x1874715939443072:12345-0@lo:253: Request processed in 37541us (38007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.272143:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787868561.272454:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939443072:0@lo:253: 10000000:01000000:3.0:1787868561.272472:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787868561.272474:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787868561.272476:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868561.272477:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868561.272478:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787868561.272479:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868561.272481:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868561.272482:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868561.272484:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787868561.272485:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868561.272486:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787868561.272506:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000010d1adf2 from lustre-MDT0001 10000000:01000000:3.0:1787868561.272541:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787868561.272544:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787868561.272552:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93daae688000 local copy 10000000:01000000:3.0:1787868561.272555:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787868561.272604:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.272615:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.272623:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.272641:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939443968:0@lo:101: 00000100:00100000:3.0:1787868561.272677:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.272722:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a90306e going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.272769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939443968 00000100:00100000:2.0:1787868561.272776:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939443968 00000100:00100000:2.0:1787868561.272843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787868561.272851:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d690e05a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+9:7442:x1874715939443968:12345-0@lo:101: 00010000:00010000:2.0:1787868561.272866:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868561.272880:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e63c3ec2/0x2f11f4d3bde2cc3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cc33 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.272902:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e63c3ec2/0x2f11f4d3bde2cc3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc33 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.272912:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e63c3ec2/0x2f11f4d3bde2cc3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc33 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.272920:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e63c3ec2, rc 0) 00000100:00100000:2.0:1787868561.272959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d690e05a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:7442:x1874715939443968:12345-0@lo:101: Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.272965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787868561.273181:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939443968:0@lo:101: 00010000:00010000:3.0:1787868561.273194:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.273388:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.273527:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444096:0@lo:501: 00000100:00100000:0.0:1787868561.273556:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.273585:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab37faca going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.273626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444096 00000100:00100000:2.0:1787868561.273630:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444096 00000100:00100000:2.0:1787868561.273661:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787868561.273667:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000921518e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:7442:x1874715939444096:12345-0@lo:501: 00000100:00100000:2.0:1787868561.273725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000921518e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:7442:x1874715939444096:12345-0@lo:501: Request processed in 58us (169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787868561.273732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868561.273805:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444096:0@lo:501: 10000000:01000000:0.0:1787868561.273819:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787868561.273832:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787868561.273836:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.273843:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.273850:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.273879:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787868561.273904:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93daaf704800 10000000:01000000:0.0:1787868561.273908:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787868561.273913:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93daae688000 10000000:01000000:0.0:1787868561.273914:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787868561.273917:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93daae688000 from 1 10000000:01000000:0.0:1787868561.273919:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787868561.273935:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.273942:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.273949:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.273959:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444224:0@lo:101: 00000100:00100000:0.0:1787868561.273984:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.274006:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60b3fb7 going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.274046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444224 00000100:00100000:2.0:1787868561.274050:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444224 00000100:00100000:2.0:1787868561.274081:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787868561.274087:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3fa2773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+10:7442:x1874715939444224:12345-0@lo:101: 00010000:00010000:2.0:1787868561.274095:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868561.274110:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006cb9a192/0x2f11f4d3bde2cc48 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cc41 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.274125:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cb9a192/0x2f11f4d3bde2cc48 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc41 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.274133:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006cb9a192/0x2f11f4d3bde2cc48 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc41 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.274140:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006cb9a192, rc 0) 00000100:00100000:2.0:1787868561.274189:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3fa2773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:7442:x1874715939444224:12345-0@lo:101: Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.274195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787868561.274334:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868561.274339:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.274347:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a9561db already unused, calling callback (00000000f6284d2a) 10000000:00010000:3.0:1787868561.274350:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.274357:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868561.274363:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868561.274369:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787868561.274388:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.274395:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868561.274422:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.274428:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2cc33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cc3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.274445:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868561.274451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868561.274453:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868561.274510:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444224:0@lo:101: 00010000:00010000:0.0:1787868561.274522:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274529:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868561.274546:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787868561.274562:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274577:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000008aee2f29/0x2f11f4d3bde2cc41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868561.274585:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93daaf704800 10000000:01000000:0.0:1787868561.274588:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787868561.274591:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93daaf704800 from 1 10000000:01000000:0.0:1787868561.274593:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787868561.274606:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274611:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274617:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.274628:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444480:0@lo:101: 00000100:00100000:0.0:1787868561.274653:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.274669:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60b3fb7 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.274683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444480 00000100:00100000:0.0:1787868561.274687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444480 00000100:00100000:0.0:1787868561.274707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868561.274713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0ed5683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+11:7442:x1874715939444480:12345-0@lo:101: 00010000:00010000:0.0:1787868561.274721:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868561.274728:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064816c8b/0x2f11f4d3bde2cc56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cc4f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274742:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064816c8b/0x2f11f4d3bde2cc56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc4f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274757:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064816c8b/0x2f11f4d3bde2cc56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc4f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274763:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064816c8b, rc 0) 00000100:00100000:0.0:1787868561.274792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0ed5683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444480:12345-0@lo:101: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.274798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868561.274821:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444480:0@lo:101: 00010000:00010000:0.0:1787868561.274830:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274836:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868561.274846:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787868561.274848:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274854:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000002cf90461/0x2f11f4d3bde2cc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868561.274860:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787868561.274863:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868561.274866:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93daaf704800 10000000:01000000:0.0:1787868561.274868:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787868561.274871:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787868561.274872:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787868561.274884:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274896:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.274903:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.274913:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444608:0@lo:101: 00000100:00100000:0.0:1787868561.274938:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.274945:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60b3fb7 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.274963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444608 00000100:00100000:0.0:1787868561.274967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444608 00000100:00100000:0.0:1787868561.274983:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868561.274988:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aea1a1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444608:12345-0@lo:101: 00010000:00010000:0.0:1787868561.274993:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868561.275001:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035965e5b/0x2f11f4d3bde2cc64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cc5d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.275013:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035965e5b/0x2f11f4d3bde2cc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.275019:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035965e5b/0x2f11f4d3bde2cc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.275025:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035965e5b, rc 0) 00000100:00100000:0.0:1787868561.275049:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aea1a1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:7442:x1874715939444608:12345-0@lo:101: Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.275055:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868561.275076:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444608:0@lo:101: 00010000:00010000:0.0:1787868561.275090:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.275096:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.275183:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444736:0@lo:501: 00000100:00100000:2.0:1787868561.275375:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939444352:0@lo:103: 00000100:00100000:2.0:1787868561.275519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.275601:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444352 00000100:00100000:1.0:1787868561.275606:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444352 00000100:00100000:1.0:1787868561.275644:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868561.275651:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4aa416 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3636:x1874715939444352:12345-0@lo:103: 00010000:00010000:1.0:1787868561.275661:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868561.275673:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e63c3ec2/0x2f11f4d3bde2cc3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc33 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.275685:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868561.275729:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4aa416 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:3636:x1874715939444352:12345-0@lo:103: Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.275737:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868561.275817:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c09157d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939444352:0@lo:103: 00000100:00100000:0.0:1787868561.275854:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.275901:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60b3fb7 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.275921:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444736 00000100:00100000:0.0:1787868561.275925:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444736 00000100:00100000:3.0:1787868561.275965:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868561.275974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003814fbb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444736:12345-0@lo:501: 00000100:00100000:3.0:1787868561.276089:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003814fbb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444736:12345-0@lo:501: Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.276096:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868561.276209:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444736:0@lo:501: 00000100:00100000:1.0:1787868561.276240:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444864:0@lo:503: 00000100:00100000:1.0:1787868561.276294:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.276309:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062643b8c going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.276444:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444864 00000100:00100000:2.0:1787868561.276448:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444864 00000100:00100000:2.0:1787868561.276474:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868561.276479:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ffb4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444864:12345-0@lo:503: 00000100:00100000:2.0:1787868561.276570:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ffb4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444864:12345-0@lo:503: Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.276577:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868561.276775:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444864:0@lo:503: 00000040:00080000:1.0:1787868561.277027:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868561.277104:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444992:0@lo:502: 00000100:00100000:1.0:1787868561.277139:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.277196:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062643b8c going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.277364:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939444992 00000100:00100000:2.0:1787868561.277370:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939444992 00000100:00100000:2.0:1787868561.277401:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787868561.277407:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caab4b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444992:12345-0@lo:502: 00000100:00100000:2.0:1787868561.277493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caab4b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939444992:12345-0@lo:502: Request processed in 86us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.277508:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868561.277874:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939444992:0@lo:502: 00000040:00080000:1.0:1787868561.278087:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787868561.278112:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787868561.278126:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787868561.278138:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787868561.278149:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787868561.278349:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787868561.278368:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787868561.278382:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787868561.278394:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787868561.278405:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787868561.278416:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787868561.278427:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787868561.278439:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787868561.278453:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787868561.278465:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787868561.278488:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787868561.278500:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787868561.278514:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787868561.278526:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787868561.278537:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787868561.278550:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787868561.278562:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787868561.278576:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787868561.278601:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445120:0@lo:502: 00000100:00100000:1.0:1787868561.278649:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.278685:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062643b8c going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.278739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445120 00000100:00100000:2.0:1787868561.278745:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445120 00000100:00100000:2.0:1787868561.278782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787868561.278789:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3a8ec7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939445120:12345-0@lo:502: 00000100:00100000:2.0:1787868561.278881:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3a8ec7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939445120:12345-0@lo:502: Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.278889:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868561.278990:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445120:0@lo:502: 00000040:00080000:1.0:1787868561.279027:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1787868561.279035:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787868561.282074:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868561.282090:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868561.282093:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787868561.282100:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787868561.282104:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868561.282120:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000060cd64b9) 00000020:00000080:3.0:1787868561.282143:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787868561.282149:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787868561.282299:0:7454:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787868561.282307:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2cc72 00000020:00000080:3.0:1787868561.282544:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787868561.282548:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868561.282552:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868561.282553:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787868561.282556:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868561.282559:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868561.282560:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787868561.282562:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868561.282575:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000028ac8ccb) 00000020:00000080:3.0:1787868561.282586:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787868561.282590:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787868561.282592:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787868561.282595:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787868561.282607:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787868561.282658:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010d1adf2 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787868561.282670:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000324c50d5) 00000020:00000080:3.0:1787868561.282678:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787868561.282752:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787868561.282757:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2cc87 00000020:00000080:3.0:1787868561.282866:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787868561.282873:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787868561.282878:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2f11f4d3bde2cc8e 00080000:01000000:3.0:1787868561.282883:0:7454:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787868561.282887:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2cc95 00080000:10000000:3.0:1787868561.283980:0:7454:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787868561.284123:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787868561.439018:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787868561.442532:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787868561.450488:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787868561.450877:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787868561.484759:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787868561.484777:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868561.484786:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868561.484788:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787868561.484792:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868561.484800:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868561.484801:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787868561.484805:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787868561.484809:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:3.0:1787868561.484838:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868561.484854:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000eec2bbd8) 00000020:00000080:3.0:1787868561.484896:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787868561.484903:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787868561.485004:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787868561.485012:0:7454:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787868561.485020:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2cca3 00010000:00080000:3.0:1787868561.485280:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3b57be4@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787868561.505243:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00010000:00010000:1.0:1787868561.516907:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787868561.517566:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787868561.517585:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787868561.517639:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787868561.517665:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ccaa 00000100:00080000:1.0:1787868561.517679:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868561.517685:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d3b57be4 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868561.517732:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000813387df x1874715939445248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868561.517768:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787868561.517839:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868561.517844:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.517847:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787868561.517851:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787868561.517856:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787868561.517867:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868561.517869:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868561.517870:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787868561.517874:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.517875:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787868561.517878:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868561.517884:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.517887:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787868561.517892:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787868561.517930:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787868561.517950:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868561.517955:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.517956:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787868561.517959:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868561.517962:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.517963:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787868561.517966:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787868561.517968:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787868561.518004:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868561.518006:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868561.518007:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787868561.518010:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1787868561.518203:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:3.0:1787868561.518218:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939445248:0@lo:38: 10000000:01000000:0.0:1787868561.518242:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787868561.518271:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.518283:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bfc8b8bd/0x2f11f4d3bde2cc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868561.518291:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daaf704800 from 1 10000000:01000000:0.0:1787868561.518294:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787868561.518324:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.518332:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868561.518332:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.518345:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868561.518505:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445376:0@lo:101: 00000100:00100000:0.0:1787868561.518543:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.518572:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b1126c2f going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.518748:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445248 00000100:00100000:2.0:1787868561.518765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445248 00000100:00100000:2.0:1787868561.518820:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868561.518827:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c09157d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939445248:12345-0@lo:38: 00010000:00080000:2.0:1787868561.518855:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1787868561.519776:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ccb8 00000004:00100000:2.0:1787868561.519796:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787868561.519804:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787868561.521485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445376 00000100:00100000:1.0:1787868561.521507:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445376 00000100:00100000:1.0:1787868561.521587:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868561.521597:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254f9632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+12:7442:x1874715939445376:12345-0@lo:101: 00010000:00010000:1.0:1787868561.521620:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868561.521643:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ccb1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.521677:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.521713:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.521723:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ab1c59c, rc 0) 00000100:00100000:1.0:1787868561.521837:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254f9632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:7442:x1874715939445376:12345-0@lo:101: Request processed in 241us (3293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.521844:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868561.522366:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445376:0@lo:101: 00010000:00010000:2.0:1787868561.522399:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.522412:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.527544:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445504:0@lo:256: 00000100:00100000:3.0:1787868561.527658:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.527725:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb804abe going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.527965:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445504 00000100:00100000:2.0:1787868561.527975:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445504 00000100:00100000:2.0:1787868561.528054:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787868561.528063:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5eb736e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:7442:x1874715939445504:12345-0@lo:256: 20000000:01000000:2.0:1787868561.528091:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787868561.528116:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787868561.528120:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787868561.528276:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5eb736e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:7442:x1874715939445504:12345-0@lo:256: Request processed in 212us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.528286:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787868561.528327:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445504:0@lo:256: 10000000:01000000:3.0:1787868561.529030:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868561.529057:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.529071:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868561.529080:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daaf704800 from 1 10000000:01000000:3.0:1787868561.529083:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868561.529123:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.529130:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.529140:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.529210:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445632:0@lo:101: 00000100:00100000:3.0:1787868561.529281:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.529319:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb804abe going to sleep for 11 seconds 00000100:00100000:1.0:1787868561.529344:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445632 00000100:00100000:1.0:1787868561.529371:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445632 00000100:00100000:1.0:1787868561.529729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868561.529741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e51cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:7442:x1874715939445632:12345-0@lo:101: 00010000:00010000:1.0:1787868561.529761:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868561.529780:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ccc6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.529812:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.529823:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.529832:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4320dad, rc 0) 00000100:00100000:1.0:1787868561.529924:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e51cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939445632:12345-0@lo:101: Request processed in 187us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.529931:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787868561.531524:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445632:0@lo:101: 00010000:00010000:3.0:1787868561.531560:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.531589:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.531761:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445760:0@lo:501: 00000100:00100000:3.0:1787868561.532576:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.532623:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb804abe going to sleep for 11 seconds 00000100:00100000:3.0:1787868561.532650:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445760 00000100:00100000:3.0:1787868561.532658:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445760 00000100:00100000:3.0:1787868561.532706:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868561.532713:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090b5d643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939445760:12345-0@lo:501: 00000100:00100000:3.0:1787868561.532868:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090b5d643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939445760:12345-0@lo:501: Request processed in 155us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.532877:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868561.532922:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445760:0@lo:501: 00000100:00100000:3.0:1787868561.532966:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445888:0@lo:503: 00000100:00100000:3.0:1787868561.533014:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.533036:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939445888 00000100:00100000:3.0:1787868561.533040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939445888 00000100:00100000:3.0:1787868561.533058:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868561.533063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5e74477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939445888:12345-0@lo:503: 00000040:00080000:3.0:1787868561.533098:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868561.533126:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5e74477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939445888:12345-0@lo:503: Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.533133:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868561.533183:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb804abe going to sleep for 11 seconds 00000100:00100000:3.0:1787868561.533199:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939445888:0@lo:503: 00000040:00080000:3.0:1787868561.533525:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868561.533603:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787868561.533685:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868561.537053:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:1.0:1787868561.537970:0:6517:0:(import.c:65:import_set_state_nolock()) 000000000885cbd6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868561.538114:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c09157d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939445248:12345-0@lo:38: Request processed in 19284us (19780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.538144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1787868561.538630:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787868561.538684:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787868561.538709:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.538723:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868561.538789:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787868561.538793:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93daaf704800 10000000:01000000:3.0:1787868561.538797:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93daaf704800 10000000:01000000:3.0:1787868561.538801:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787868561.538808:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daaf704800 from 1 10000000:01000000:3.0:1787868561.538811:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:0.0:1787868561.538961:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868561.538974:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787868561.538983:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787868561.538989:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787868561.538992:0:3635:0:(import.c:65:import_set_state_nolock()) 00000000d3b57be4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787868561.539005:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000813387df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939445248:0@lo:38: 00010000:00010000:3.0:1787868561.539098:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.539106:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.539114:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.539136:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446016:0@lo:101: 00000100:00100000:3.0:1787868561.539218:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.539273:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb804abe going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.539602:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446016 00000100:00100000:0.0:1787868561.539610:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446016 00000100:00100000:0.0:1787868561.539699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868561.539708:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b71ecb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:7442:x1874715939446016:12345-0@lo:101: 00010000:00010000:0.0:1787868561.539723:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868561.539738:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2ccdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ccd4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.539764:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2ccdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.539775:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8b131ef/0x2f11f4d3bde2ccdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868561.539784:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8b131ef, rc 0) 00000100:00100000:0.0:1787868561.539842:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b71ecb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446016:12345-0@lo:101: Request processed in 135us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.539856:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787868561.540223:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446016:0@lo:101: 00010000:00010000:1.0:1787868561.540243:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868561.540264:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868561.540405:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446272:0@lo:501: 00000100:00100000:1.0:1787868561.540441:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.540508:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939446144:0@lo:41: 00000100:00100000:3.0:1787868561.540543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.546602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446272 00000100:00100000:2.0:1787868561.546702:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446272 00000100:00100000:0.0:1787868561.547277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446144 00000100:00100000:0.0:1787868561.547285:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446144 00000100:00100000:0.0:1787868561.547458:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868561.547471:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a666a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939446144:12345-0@lo:41: 00000004:00000024:0.0:1787868561.547524:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787868561.547644:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a666a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939446144:12345-0@lo:41: Request processed in 176us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.547652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868561.547717:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df72357d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939446144:0@lo:41: 00000100:00100000:3.0:1787868561.551438:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868561.551456:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c9302e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446272:12345-0@lo:501: 00000100:00100000:3.0:1787868561.551698:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c9302e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446272:12345-0@lo:501: Request processed in 246us (11255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.551707:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868561.558522:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e90c20e going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.558584:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb46d040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446272:0@lo:501: 00000100:00100000:0.0:1787868561.558668:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c322dc6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446400:0@lo:503: 00000100:00100000:0.0:1787868561.558778:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.558928:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f1a8dfe going to sleep for 11 seconds 00000100:00100000:3.0:1787868561.561031:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446400 00000100:00100000:3.0:1787868561.561050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446400 00000100:00100000:3.0:1787868561.562598:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868561.562627:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d4012d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446400:12345-0@lo:503: 00000100:00100000:3.0:1787868561.562889:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d4012d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446400:12345-0@lo:503: Request processed in 277us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.562898:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787868561.563037:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c322dc6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446400:0@lo:503: 00000040:00080000:1.0:1787868561.563478:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868561.563590:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446528:0@lo:502: 00000100:00100000:1.0:1787868561.563660:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.567838:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000008cd02942 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.569630:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446528 00000100:00100000:0.0:1787868561.569648:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446528 00000100:00100000:2.0:1787868561.571278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787868561.571294:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059afbfd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446528:12345-0@lo:502: 00000100:00100000:2.0:1787868561.571563:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059afbfd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446528:12345-0@lo:502: Request processed in 271us (7903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.571571:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868561.572232:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446528:0@lo:502: 00000040:00080000:0.0:1787868561.572643:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787868561.572679:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787868561.572691:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787868561.572701:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787868561.572711:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787868561.572722:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787868561.572732:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787868561.572744:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787868561.572754:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787868561.572789:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787868561.572805:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787868561.572962:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787868561.572977:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787868561.572991:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787868561.573003:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787868561.573014:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787868561.573026:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787868561.573039:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787868561.573050:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787868561.573063:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787868561.573076:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787868561.573089:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787868561.573102:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787868561.573116:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787868561.573130:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787868561.573186:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787868561.573202:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787868561.573213:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787868561.573273:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e96c527 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446656:0@lo:502: 00000100:00100000:0.0:1787868561.573367:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.573415:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073f8692b going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.573756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446656 00000100:00100000:2.0:1787868561.573766:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446656 00000100:00100000:2.0:1787868561.573834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868561.573843:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b18e5e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446656:12345-0@lo:502: 00000100:00100000:2.0:1787868561.573991:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b18e5e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446656:12345-0@lo:502: Request processed in 150us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.573999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787868561.575664:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e96c527 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446656:0@lo:502: 00000040:00080000:0.0:1787868561.575800:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787868561.575997:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787868561.578371:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787868561.578395:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005ccae92a) 00000020:00000080:1.0:1787868561.578426:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787868561.578523:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010d1adf2 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787868561.578529:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000010d1adf2 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787868561.578532:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000010d1adf2 3 00010000:00080000:1.0:1787868561.578596:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ef556ed1@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787868561.580613:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787868561.580948:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787868561.581004:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787868561.581020:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2f11f4d3bde2cce9 00000100:00080000:0.0:1787868561.581034:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787868561.581040:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ef556ed1 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868561.581095:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004e96c527 x1874715939446784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787868561.581127:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787868561.582063:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e96c527 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939446784:0@lo:38: 00000100:00100000:3.0:1787868561.582187:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868561.585011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446784 00000100:00100000:0.0:1787868561.585031:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446784 00000100:00100000:0.0:1787868561.585089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868561.585098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000473b70bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939446784:12345-0@lo:38: 00010000:00080000:0.0:1787868561.585138:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787868561.585218:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f11f4d3bde2ccf0 00000004:00100000:0.0:1787868561.585237:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787868561.585294:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000671f5d8d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868561.585694:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000473b70bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874715939446784:12345-0@lo:38: Request processed in 593us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.585702:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787868561.585780:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004e96c527 x1874715939446784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868561.585796:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787868561.585807:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787868561.585825:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787868561.585832:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787868561.585834:0:3635:0:(import.c:65:import_set_state_nolock()) 00000000ef556ed1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787868561.585842:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e96c527 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939446784:0@lo:38: 00000040:00080000:1.0:1787868561.587444:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1787868561.587572:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1787868561.587660:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787868561.587711:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787868561.587743:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.587757:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000a09c4a60/0x2f11f4d3bde2ccd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787868561.587835:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787868561.587838:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868561.587840:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868561.587841:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868561.587842:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868561.587844:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868561.587845:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868561.587847:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787868561.587849:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787868561.587850:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868561.587852:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787868561.587857:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1787868561.587860:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787868561.587861:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868561.587862:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868561.587863:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868561.587865:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868561.587866:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868561.587867:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868561.587868:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787868561.587869:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787868561.587870:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868561.587871:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787868561.587905:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787868561.587928:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446912:0@lo:253: 00000100:00100000:3.0:1787868561.588023:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.588081:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000006838c874 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.588226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939446912 00000100:00100000:0.0:1787868561.588236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939446912 00000100:00100000:0.0:1787868561.588308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787868561.588319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007628d971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446912:12345-0@lo:253: 20000000:01000000:0.0:1787868561.588509:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787868561.588528:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787868561.599145:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787868561.599340:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787868561.599529:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787868561.602182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007628d971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7442:x1874715939446912:12345-0@lo:253: Request processed in 13827us (14122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.602204:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787868561.602480:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2574122 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7442:1874715939446912:0@lo:253: 10000000:01000000:0.0:1787868561.602501:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787868561.602504:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868561.602507:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787868561.602527:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868561.602528:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868561.602530:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868561.602531:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868561.602533:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787868561.602534:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868561.602536:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868561.602538:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868561.602539:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787868561.602565:0:7442:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787868561.608223:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787868561.608241:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787868561.611248:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611313:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611321:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611329:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611505:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611524:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.611541:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000382d1d4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939447040:0@lo:104: 00000100:00100000:3.0:1787868561.611625:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868561.611689:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.611697:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 14 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.611704:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939447168:0@lo:104: 00000100:00100000:3.0:1787868561.611725:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.611751:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c146f33 going to sleep for 11 seconds 00000100:00100000:2.0:1787868561.611954:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447040 00000100:00100000:2.0:1787868561.611963:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447040 00000100:00100000:2.0:1787868561.612008:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447168 00000100:00100000:2.0:1787868561.612010:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447168 00000100:00100000:2.0:1787868561.612024:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787868561.612033:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d89cc09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939447040:12345-0@lo:104: 00010000:00010000:2.0:1787868561.612047:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.612120:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868561.612125:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d89cc09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939447040:12345-0@lo:104: Request processed in 94us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.612133:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787868561.612199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787868561.612205:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000509f84a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939447168:12345-0@lo:104: 00010000:00010000:2.0:1787868561.612213:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.612247:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787868561.612262:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000509f84a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939447168:12345-0@lo:104: Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.612269:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787868561.612289:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868561.612295:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.612321:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ecb2717 already unused, calling callback (00000000f6284d2a) 10000000:00010000:2.0:1787868561.612325:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.612333:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868561.612340:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868561.612346:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868561.614007:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614020:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868561.614047:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614055:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2ccb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccbf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614071:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868561.614075:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614082:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd6a6ba6 already unused, calling callback (00000000f6284d2a) 10000000:00010000:2.0:1787868561.614084:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614107:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868561.614113:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868561.614118:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868561.614133:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614139:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868561.614143:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614149:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2cc10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868561.614180:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868561.614182:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868561.614184:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868561.614199:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868561.614504:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000382d1d4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939447040:0@lo:104: 00000100:00100000:3.0:1787868561.614523:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939447168:0@lo:104: 00010000:00010000:3.0:1787868561.614566:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868561.615297:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939447424:0@lo:103: 00000100:00100000:2.0:1787868561.616549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.616627:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868561.616636:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939447296:0@lo:103: 00000100:00100000:2.0:1787868561.616683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.617082:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447424 00000100:00100000:3.0:1787868561.617094:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447424 00010000:00010000:3.0:1787868561.617134:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 15 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.617179:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447296 00000100:00100000:3.0:1787868561.617182:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447296 00010000:00010000:3.0:1787868561.617191:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 16 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868561.617205:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868561.617213:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094c8a1bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939447424:12345-0@lo:103: 00010000:00010000:3.0:1787868561.617229:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868561.617234:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 16 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.617245:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 16 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.617279:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cc17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc10 expref: 16 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.617299:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868561.617344:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094c8a1bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3639:x1874715939447424:12345-0@lo:103: Request processed in 132us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.618202:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787868561.618214:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787868561.618287:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcad9900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939447424:0@lo:103: 00000100:00100000:3.0:1787868561.619104:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868561.619142:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787868561.619171:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76a7e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3639:x1874715939447296:12345-0@lo:103: 00010000:00010000:3.0:1787868561.619192:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868561.619202:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619217:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619236:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2ccbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccb1 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619265:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619275:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787868561.619292:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011054703s 00010000:00010000:3.0:1787868561.619296:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619303:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619309:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619315:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619322:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098881ac7 already unused, calling callback (000000002ccb6f0c) 00010000:00010000:3.0:1787868561.619330:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619340:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619436:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619450:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868561.619527:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76a7e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3639:x1874715939447296:12345-0@lo:103: Request processed in 371us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.619534:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787868561.619602:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619610:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868561.619616:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2ccf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787868561.620798:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:2.0:1787868561.621097:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939447296:0@lo:103: 00080000:10000000:0.0:1787868561.623302:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787868561.625726:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787868561.627324:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787868561.627616:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787868561.627773:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787868561.634285:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787868561.635281:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787868561.638781:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787868561.643108:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787868561.644122:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787868561.646781:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787868561.658845:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787868561.658902:0:7466:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787868561.658907:0:7466:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787868561.659618:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787868561.659690:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1874715939447552:0@lo:700: 00000100:00100000:2.0:1787868561.659788:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1787868561.659816:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787868561.659878:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d3ccf0f going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.660189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447552 00000100:00100000:0.0:1787868561.660198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447552 00000100:00100000:0.0:1787868561.660264:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868561.660275:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcad9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1874715939447552:12345-0@lo:700: 00000100:00100000:2.0:1787868561.661006:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000628ac71e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939447680:0@lo:1000: 00000100:00100000:2.0:1787868561.661084:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.661130:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fadafb9 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.661193:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447680 00000100:00100000:0.0:1787868561.661199:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447680 00000100:00100000:0.0:1787868561.661239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868561.661247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003699b42c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939447680:12345-0@lo:1000: 00000100:00100000:3.0:1787868561.661537:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000628ac71e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939447680:0@lo:1000: 00000040:01000000:1.0:1787868561.661561:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:01000000:3.0:1787868561.661574:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787868561.661601:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939447808:0@lo:700: 00000040:00080000:1.0:1787868561.661688:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787868561.662145:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787868561.662182:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787868561.662347:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868561.663370:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787868561.663979:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868561.664517:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ebedba46 going to sleep for 11 seconds 00000100:00100000:0.0:1787868561.665573:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003699b42c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939447680:12345-0@lo:1000: Request processed in 4319us (4481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868561.665593:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1787868561.666492:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1787868561.666683:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447808 00000100:00100000:2.0:1787868561.666697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447808 00000100:00100000:2.0:1787868561.666764:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868561.666774:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000382d1d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939447808:12345-0@lo:700: 00000100:00100000:2.0:1787868561.666923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000382d1d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939447808:12345-0@lo:700: Request processed in 150us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868561.666931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1787868561.667662:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787868561.668057:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787868561.668337:0:7442:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787868561.668985:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787868561.669129:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787868561.669312:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787868561.670091:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787868561.670889:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787868561.671059:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:2.0:1787868561.674700:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939447808:0@lo:700: 00000100:00100000:2.0:1787868561.676085:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1874715939447936:0@lo:900: 00000100:00100000:2.0:1787868561.676216:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.676286:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098b07c26 going to sleep for 11 seconds 00000100:00100000:1.0:1787868561.676334:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939447936 00000100:00100000:1.0:1787868561.676345:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939447936 00000100:00100000:1.0:1787868561.676428:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868561.676438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628ac71e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1874715939447936:12345-0@lo:900: 00000100:00100000:1.0:1787868561.676514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628ac71e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1874715939447936:12345-0@lo:900: Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.676522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:1.0:1787868561.676561:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1787868561.676764:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787868561.677301:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787868561.679891:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787868561.680121:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787868561.680328:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00010000:00080000:2.0:1787868561.681309:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ed15d883 x1874715939447936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868561.681334:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1874715939447936:0@lo:900: 00000100:00100000:2.0:1787868561.681634:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448064:0@lo:1000: 00000100:00100000:2.0:1787868561.681721:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:0.0:1787868561.682242:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787868561.682456:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787868561.682601:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787868561.682733:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787868561.682877:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:2.0:1787868561.683148:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000004840fdda going to sleep for 11 seconds 00000100:00100000:1.0:1787868561.685905:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcad9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1874715939447552:12345-0@lo:700: Request processed in 25620us (26106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.685934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787868561.686489:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d86531ed x1874715939447552/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787868577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868561.686509:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d86531ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1874715939447552:0@lo:700: 40000000:02000000:2.0:1787868561.686527:0:7467:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1787868561.690283:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787868561.690645:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787868561.690787:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787868561.691020:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787868561.691194:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:3.0:1787868561.692270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448064 00000100:00100000:3.0:1787868561.692290:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448064 00000100:00100000:3.0:1787868561.692498:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868561.692511:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4aa416 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448064:12345-0@lo:1000: 00000100:00100000:3.0:1787868561.692691:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4aa416 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448064:12345-0@lo:1000: Request processed in 183us (10970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868561.692700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:0.0:1787868561.692741:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787868561.693717:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787868561.693991:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787868561.694116:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787868561.694290:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000100:00100000:2.0:1787868561.699321:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448064:0@lo:1000: 00000004:00080000:2.0:1787868561.699445:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000098b07c26 with version 0 00000020:00100000:2.0:1787868561.699488:0:7468:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787868561.699497:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ed15d883 x1874715939448320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868561.699523:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448320:0@lo:1000: 00000100:00100000:2.0:1787868561.699607:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.699670:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000004840fdda going to sleep for 11 seconds 00000100:00100000:3.0:1787868561.699964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448320 00000100:00100000:3.0:1787868561.699975:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448320 00000100:00100000:3.0:1787868561.700034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868561.700045:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d86531ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448320:12345-0@lo:1000: 00000001:00080000:1.0:1787868561.709415:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1787868561.709611:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d86531ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448320:12345-0@lo:1000: Request processed in 9562us (9999us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787868561.709629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787868561.709942:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787868561.709950:0:7468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787868561.709975:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448320:0@lo:1000: 00000100:00100000:3.0:1787868561.710093:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448448:0@lo:1000: 00000100:00100000:3.0:1787868561.710177:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868561.710208:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448448 00000100:00100000:1.0:1787868561.710215:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448448 00000100:00100000:3.0:1787868561.710220:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d9f4330 going to sleep for 11 seconds 00000100:00100000:1.0:1787868561.710282:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868561.710293:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2574122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448448:12345-0@lo:1000: 00000100:00100000:1.0:1787868561.710388:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2574122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1874715939448448:12345-0@lo:1000: Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868561.710396:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868561.710436:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c288f3b3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1874715939448448:0@lo:1000: 00000040:00080000:1.0:1787868561.710458:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1787868561.710484:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000004:00080000:1.0:1787868561.711351:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000694ffb52 with version 1 00000004:00080000:2.0:1787868561.711730:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ded3ac1a version 1 rpc_version 1 00000020:00100000:2.0:1787868561.711762:0:7457:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787868561.711772:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000094c8a1bd x1874715939448704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868561.711796:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1874715939448704:0@lo:1000: 00000100:00100000:2.0:1787868561.711869:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868561.711909:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2b96a34 going to sleep for 11 seconds 00000100:00100000:3.0:1787868561.711966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448704 00000100:00100000:3.0:1787868561.711973:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448704 00000100:00100000:3.0:1787868561.712019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868561.712026:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df72357d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7457:x1874715939448704:12345-0@lo:1000: 00100000:10000000:2.0:1787868561.718558:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787868561.718765:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787868561.718917:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787868561.719078:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787868561.719247:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787868561.719503:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787868561.719535:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787868561.719631:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1787868561.723060:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787868561.730854:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df72357d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7457:x1874715939448704:12345-0@lo:1000: Request processed in 18812us (18969us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787868561.730879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787868561.738589:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787868561.738607:0:7457:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787868561.738640:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1874715939448704:0@lo:1000: 00000040:00080000:2.0:1787868561.748533:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787868561.749636:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787868561.749692:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3fe41c9b988 00100000:10000000:1.0:1787868561.749703:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787868561.752259:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787868561.752305:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787868561.752325:0:7442:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787868561.752358:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787868561.753238:0:7442:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868561.753462:0:7442:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787868561.784625:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787868561.784742:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787868561.784749:0:7467:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787868562.535942:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868563.553599:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868564.579050:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868565.601490:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868566.625897:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868566.821349:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939449088:0@lo:400: 00000100:00100000:2.0:1787868566.821426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868566.821488:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868566.821494:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939449216:0@lo:400: 00000100:00100000:2.0:1787868566.821522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868566.821556:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449088 00000100:00100000:2.0:1787868566.821563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449088 00000100:00100000:2.0:1787868566.821612:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868566.821622:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fef31122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939449088:12345-0@lo:400: 00000100:00100000:2.0:1787868566.821680:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fef31122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939449088:12345-0@lo:400: Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868566.821687:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868566.821711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449216 00000100:00100000:2.0:1787868566.821714:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449216 00000100:00100000:2.0:1787868566.821739:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868566.821752:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb07a961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939449216:12345-0@lo:400: 00000100:00100000:2.0:1787868566.821781:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb07a961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939449216:12345-0@lo:400: Request processed in 31us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868566.821787:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787868566.821822:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009252c333 x1874715939449216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868566.821837:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939449216:0@lo:400: 00000100:00100000:2.0:1787868566.821847:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed15d883 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939449088:0@lo:400: 00000100:00100000:3.0:1787868566.822027:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a5fb2c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939448832:0@lo:400: 00000100:00100000:3.0:1787868566.822062:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868566.822091:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006576582f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939449344:0@lo:41: 00000100:00100000:3.0:1787868566.822113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868566.822132:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868566.822138:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939448960:0@lo:400: 00000100:00100000:3.0:1787868566.822187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868566.822223:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448960 00000100:00100000:3.0:1787868566.822228:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448960 00000100:00100000:3.0:1787868566.822253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868566.822259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd9ec465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939448960:12345-0@lo:400: 00000100:00100000:3.0:1787868566.822293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd9ec465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939448960:12345-0@lo:400: Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868566.822299:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868566.822315:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449344 00000100:00100000:3.0:1787868566.822318:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449344 00000100:00100000:3.0:1787868566.822337:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868566.822342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c288f3b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939449344:12345-0@lo:41: 00000004:00000024:3.0:1787868566.822368:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787868566.822401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c288f3b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939449344:12345-0@lo:41: Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868566.822407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787868566.822435:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000094c8a1bd x1874715939448960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868566.822445:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094c8a1bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939448960:0@lo:400: 00000100:00100000:3.0:1787868566.822457:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006576582f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939449344:0@lo:41: 00000100:00100000:2.0:1787868566.823258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939448832 00000100:00100000:2.0:1787868566.823266:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939448832 00000100:00100000:2.0:1787868566.823385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787868566.823394:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090d7bff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3636:x1874715939448832:12345-0@lo:400: 00000100:00100000:2.0:1787868566.823458:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090d7bff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:3636:x1874715939448832:12345-0@lo:400: Request processed in 67us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868566.823464:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868566.823523:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a5fb2c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939448832:0@lo:400: 00000001:02000400:1.0:1787868566.852500:0:7713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787868567.330223:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787868567.330232:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daaf704800 from 4 10000000:01000000:2.0:1787868567.330237:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868567.330284:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.330296:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.330307:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.330329:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449472:0@lo:101: 00000100:00100000:2.0:1787868567.330405:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.330456:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007741ff8b going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.330603:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449472 00000100:00100000:1.0:1787868567.330611:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449472 00000100:00100000:1.0:1787868567.330658:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787868567.330666:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f920076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:6510:x1874715939449472:12345-0@lo:101: 00010000:00010000:1.0:1787868567.330680:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868567.330693:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f4fd74e/0x2f11f4d3bde2cd05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ccfe expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.330714:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f4fd74e/0x2f11f4d3bde2cd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.330723:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f4fd74e/0x2f11f4d3bde2cd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.330738:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f4fd74e, rc 0) 00000100:00100000:1.0:1787868567.330787:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f920076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:6510:x1874715939449472:12345-0@lo:101: Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.330794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787868567.330868:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449472:0@lo:101: 00010000:00010000:2.0:1787868567.330881:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.330889:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.330933:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449600:0@lo:256: 00000100:00100000:2.0:1787868567.330963:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.330991:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007741ff8b going to sleep for 11 seconds 00000100:00100000:0.0:1787868567.331043:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449600 00000100:00100000:0.0:1787868567.331049:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449600 00000100:00100000:0.0:1787868567.331083:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787868567.331097:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e405dd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:6510:x1874715939449600:12345-0@lo:256: 20000000:01000000:0.0:1787868567.331113:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787868567.331127:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787868567.331130:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787868567.331244:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e405dd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:6510:x1874715939449600:12345-0@lo:256: Request processed in 148us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.331251:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787868567.331281:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009252c333 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449600:0@lo:256: 10000000:01000000:0.0:1787868567.331320:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787868567.331326:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331333:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bd6a6ba6/0x2f11f4d3bde2ccfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868567.331342:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787868567.331344:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05d8800 from 21 10000000:01000000:0.0:1787868567.331347:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868567.331363:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331370:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331377:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868567.331387:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449728:0@lo:101: 00000100:00100000:0.0:1787868567.331409:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.331427:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1950732 going to sleep for 11 seconds 00000100:00100000:0.0:1787868567.331437:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449728 00000100:00100000:0.0:1787868567.331441:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449728 00000100:00100000:0.0:1787868567.331456:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787868567.331461:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000023215d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:6510:x1874715939449728:12345-0@lo:101: 00010000:00010000:0.0:1787868567.331468:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868567.331474:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cd13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd0c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331486:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331492:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4b2a760/0x2f11f4d3bde2cd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331498:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4b2a760, rc 0) 00000100:00100000:0.0:1787868567.331524:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000023215d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939449728:12345-0@lo:101: Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.331529:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787868567.331555:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449728:0@lo:101: 00010000:00010000:0.0:1787868567.331564:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.331570:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868567.331621:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449856:0@lo:501: 00000100:00100000:0.0:1787868567.331646:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.331659:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1950732 going to sleep for 11 seconds 00000100:00100000:0.0:1787868567.331674:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449856 00000100:00100000:0.0:1787868567.331678:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449856 00000100:00100000:0.0:1787868567.331695:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787868567.331700:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000176446be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939449856:12345-0@lo:501: 00000100:00100000:0.0:1787868567.331812:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000176446be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939449856:12345-0@lo:501: Request processed in 111us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.331818:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787868567.331845:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449856:0@lo:501: 00000100:00100000:0.0:1787868567.331871:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449984:0@lo:503: 00000100:00100000:0.0:1787868567.331913:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.331926:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1950732 going to sleep for 11 seconds 00000100:00100000:0.0:1787868567.331937:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939449984 00000100:00100000:0.0:1787868567.331941:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939449984 00000100:00100000:0.0:1787868567.331958:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787868567.331964:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a76a3e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939449984:12345-0@lo:503: 00000100:00100000:0.0:1787868567.332043:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a76a3e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939449984:12345-0@lo:503: Request processed in 79us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.332051:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787868567.332086:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939449984:0@lo:503: 00000100:00100000:0.0:1787868567.332505:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7736:1874715939450112:0@lo:502: 00000100:00100000:0.0:1787868567.332537:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.332596:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d9f4330 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.334290:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450112 00000100:00100000:1.0:1787868567.334301:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450112 00000100:00100000:0.0:1787868567.337628:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868567.337643:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ec8344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7736:x1874715939450112:12345-0@lo:502: 00000100:00100000:0.0:1787868567.337833:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ec8344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7736:x1874715939450112:12345-0@lo:502: Request processed in 194us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.337849:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868567.339477:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7736:1874715939450112:0@lo:502: 00000100:00100000:1.0:1787868567.339567:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7736:1874715939450240:0@lo:502: 00000100:00100000:1.0:1787868567.339630:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868567.339961:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f2c67a5 going to sleep for 11 seconds 00000100:00100000:2.0:1787868567.343339:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450240 00000100:00100000:2.0:1787868567.343356:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450240 00000100:00100000:2.0:1787868567.343423:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787868567.343432:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000828659c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7736:x1874715939450240:12345-0@lo:502: 00000100:00100000:2.0:1787868567.343614:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000828659c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:7736:x1874715939450240:12345-0@lo:502: Request processed in 183us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868567.343621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868567.343735:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7736:1874715939450240:0@lo:502: 00000040:00080000:1.0:1787868567.343771:0:7736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787868567.343938:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787868567.343961:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787868567.343970:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.343981:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000002ecb2717/0x2f11f4d3bde2cd0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868567.343990:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787868567.343999:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05d8800 from 4 10000000:01000000:2.0:1787868567.344002:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868567.344031:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.344038:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.344046:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.344064:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450368:0@lo:101: 00000100:00100000:2.0:1787868567.344100:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.344138:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abed473 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.344233:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450368 00000100:00100000:1.0:1787868567.344238:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450368 00000100:00100000:1.0:1787868567.344258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787868567.344264:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd56ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939450368:12345-0@lo:101: 00010000:00010000:1.0:1787868567.344273:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868567.344285:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cd21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd1a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.344305:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.344314:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ab1c59c/0x2f11f4d3bde2cd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.344332:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ab1c59c, rc 0) 00000100:00100000:1.0:1787868567.344373:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd56ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939450368:12345-0@lo:101: Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.344379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787868567.344441:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450368:0@lo:101: 00010000:00010000:2.0:1787868567.344452:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.344460:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.344504:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450496:0@lo:256: 00000100:00100000:2.0:1787868567.344535:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.344562:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abed473 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.344605:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450496 00000100:00100000:1.0:1787868567.344609:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450496 00000100:00100000:1.0:1787868567.344626:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868567.344631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f330e4b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939450496:12345-0@lo:256: 20000000:01000000:1.0:1787868567.344643:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787868567.344659:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787868567.344662:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787868567.344737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f330e4b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939450496:12345-0@lo:256: Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.344744:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787868567.347887:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450496:0@lo:256: 10000000:01000000:2.0:1787868567.347965:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787868567.347975:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.348000:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000e63c3ec2/0x2f11f4d3bde2cd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868567.348010:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787868567.348012:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787868567.348015:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787868567.348050:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.348057:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.348065:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.348081:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450624:0@lo:101: 00000100:00100000:2.0:1787868567.348138:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.348213:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abed473 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.348277:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450624 00000100:00100000:1.0:1787868567.348284:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450624 00000100:00100000:1.0:1787868567.348322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868567.348331:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cecccff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939450624:12345-0@lo:101: 00010000:00010000:1.0:1787868567.348343:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868567.348355:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dbf86d78/0x2f11f4d3bde2cd2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd28 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.348375:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbf86d78/0x2f11f4d3bde2cd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.348384:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dbf86d78/0x2f11f4d3bde2cd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.348403:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dbf86d78, rc 0) 00000100:00100000:1.0:1787868567.348450:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cecccff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939450624:12345-0@lo:101: Request processed in 120us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.348457:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787868567.348590:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450624:0@lo:101: 00010000:00010000:2.0:1787868567.348602:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868567.348609:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.348665:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450752:0@lo:501: 00000100:00100000:2.0:1787868567.348691:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.348722:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abed473 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.348761:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450752 00000100:00100000:1.0:1787868567.348765:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450752 00000100:00100000:1.0:1787868567.348792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787868567.348798:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7435fce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939450752:12345-0@lo:501: 00000100:00100000:1.0:1787868567.348917:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7435fce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939450752:12345-0@lo:501: Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.348924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787868567.349014:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450752:0@lo:501: 00000100:00100000:2.0:1787868567.349041:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450880:0@lo:503: 00000100:00100000:2.0:1787868567.349077:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.349097:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abed473 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.349131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939450880 00000100:00100000:1.0:1787868567.349135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939450880 00000100:00100000:1.0:1787868567.349196:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787868567.349203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d257b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939450880:12345-0@lo:503: 00000100:00100000:1.0:1787868567.349279:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d257b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939450880:12345-0@lo:503: Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.349286:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787868567.349409:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000279cbae2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939450880:0@lo:503: 00000100:00100000:0.0:1787868567.349732:0:7737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7737:1874715939451008:0@lo:502: 00000100:00100000:0.0:1787868567.349770:0:7737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.349799:0:7737:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037c36902 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.349843:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451008 00000100:00100000:1.0:1787868567.349847:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451008 00000100:00100000:1.0:1787868567.349876:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787868567.349881:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd3f7321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:7737:x1874715939451008:12345-0@lo:502: 00000100:00100000:1.0:1787868567.349964:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd3f7321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:7737:x1874715939451008:12345-0@lo:502: Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.349970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868567.350063:0:7737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7737:1874715939451008:0@lo:502: 00000020:01000000:2.0:1787868567.350089:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868567.350099:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868567.350101:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787868567.350111:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787868567.350114:0:7737:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:2.0:1787868567.350135:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868567.350190:0:7737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000304d3a86) 00000020:00000080:2.0:1787868567.350211:0:7737:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787868567.350218:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787868567.350298:0:7737:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787868567.350303:0:7737:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787868567.350310:0:7737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cd3d 00010000:00080000:2.0:1787868567.350349:0:7737:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008e5e499b@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787868567.352109:0:7737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787868567.353138:0:7737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868567.353194:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787868567.353234:0:7737:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787868567.353257:0:7737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2cd44 00000100:00080000:1.0:1787868567.353269:0:7737:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868567.353275:0:7737:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000008e5e499b using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868567.353308:0:7737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a6c5536 x1874715939451136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868567.353331:0:7737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787868567.353372:0:7737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787868567.353816:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d182adb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939451264:0@lo:400: 00000100:00100000:1.0:1787868567.353880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.353966:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451264 00000100:00100000:0.0:1787868567.353975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451264 00000100:00100000:0.0:1787868567.354029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868567.354037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a2e807f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939451264:12345-0@lo:400: 00000100:00100000:0.0:1787868567.354092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a2e807f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939451264:12345-0@lo:400: Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.354098:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787868567.354206:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008d182adb x1874715939451264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868567.354219:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d182adb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939451264:0@lo:400: 00000100:00100000:3.0:1787868567.354327:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939451136:0@lo:38: 00000100:00100000:3.0:1787868567.354382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.354522:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451136 00000100:00100000:0.0:1787868567.354526:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451136 00000100:00100000:0.0:1787868567.354551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787868567.354556:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000749e17ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939451136:12345-0@lo:38: 00010000:00080000:0.0:1787868567.354576:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1787868567.354613:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2cd4b 00000004:00100000:0.0:1787868567.354627:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787868567.354632:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787868567.354898:0:7740:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000005a8d42b7 x1874715939451648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868567.354910:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8d67aa9 going to sleep for 0 seconds 00000020:01000000:0.0:1787868567.355000:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868567.355006:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868567.355008:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787868567.355012:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868567.355016:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868567.355018:0:7737:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787868567.355021:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868567.355023:0:7737:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787868567.355045:0:7737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004be9c991 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7737:1874715939451776:0@lo:502: 00000100:00100000:0.0:1787868567.355096:0:7737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.355120:0:7737:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3e30087 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.355196:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451776 00000100:00100000:1.0:1787868567.355201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451776 00000100:00100000:1.0:1787868567.355242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787868567.355248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f1f6092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:7737:x1874715939451776:12345-0@lo:502: 00000100:00100000:1.0:1787868567.355348:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f1f6092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:7737:x1874715939451776:12345-0@lo:502: Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.355355:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787868567.355482:0:7737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004be9c991 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:7737:1874715939451776:0@lo:502: 00000020:01000000:0.0:1787868567.355507:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868567.355511:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868567.355512:0:7737:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787868567.355516:0:7737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787868567.355654:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787868567.355676:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787868567.355684:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.355701:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000082e59bc3/0x2f11f4d3bde2cd28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868567.355711:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787868567.355713:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93daae688000 from 1 10000000:01000000:1.0:1787868567.355716:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787868567.355740:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.355747:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.355755:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868567.355768:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092dd91b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939451904:0@lo:101: 00000100:00100000:1.0:1787868567.355797:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868567.355826:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000694ffb52 going to sleep for 11 seconds 00000100:00100000:3.0:1787868567.355864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451904 00000100:00100000:3.0:1787868567.355869:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451904 00000100:00100000:3.0:1787868567.355902:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787868567.355909:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f9ed1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939451904:12345-0@lo:101: 00010000:00010000:3.0:1787868567.355918:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868567.355929:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008db8a034/0x2f11f4d3bde2cd59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd52 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868567.355949:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008db8a034/0x2f11f4d3bde2cd59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868567.355957:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008db8a034/0x2f11f4d3bde2cd59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868567.355965:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008db8a034, rc 0) 00000100:00100000:3.0:1787868567.356005:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f9ed1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939451904:12345-0@lo:101: Request processed in 97us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868567.356011:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787868567.356091:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092dd91b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939451904:0@lo:101: 00010000:00010000:0.0:1787868567.356102:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868567.356110:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868567.356209:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004be9c991 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939452032:0@lo:501: 00000100:00100000:0.0:1787868567.356236:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.356252:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcdcd5db going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.356303:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452032 00000100:00100000:1.0:1787868567.356308:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452032 00000100:00100000:1.0:1787868567.356342:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787868567.356349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056cc336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939452032:12345-0@lo:501: 00000100:00100000:1.0:1787868567.356415:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056cc336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939452032:12345-0@lo:501: Request processed in 67us (178us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787868567.356422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787868567.356452:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004be9c991 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939452032:0@lo:501: 10000000:01000000:1.0:1787868567.356471:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787868567.356482:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868567.356489:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000089ed52b7/0x2f11f4d3bde2cd52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868567.356802:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009998f33e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939451392:0@lo:400: 00000100:00100000:2.0:1787868567.356837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.356903:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868567.356911:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a37948fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939451520:0@lo:400: 00000100:00100000:2.0:1787868567.356936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868567.357014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451520 00000100:00100000:0.0:1787868567.357018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451520 00000100:00100000:0.0:1787868567.357055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787868567.357061:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b56cae1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939451520:12345-0@lo:400: 00000100:00100000:0.0:1787868567.357105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b56cae1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939451520:12345-0@lo:400: Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868567.357111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787868567.357202:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a37948fc x1874715939451520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868567.357221:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a37948fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939451520:0@lo:400: 00000100:00100000:3.0:1787868567.357490:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787868567.357499:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787868567.357688:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451392 00000100:00100000:3.0:1787868567.357693:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451392 00000100:00100000:1.0:1787868567.357820:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787868567.357827:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000279cbae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939451392:12345-0@lo:400: 00000100:00100000:1.0:1787868567.357915:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000279cbae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939451392:12345-0@lo:400: Request processed in 89us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.357922:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868567.357968:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009998f33e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939451392:0@lo:400: 00000100:00080000:3.0:1787868567.374389:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000fd6c95e9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868567.374484:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000749e17ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939451136:12345-0@lo:38: Request processed in 19926us (20101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868567.374504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787868567.374632:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868567.374642:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787868567.374650:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787868567.374656:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787868567.374658:0:3635:0:(import.c:65:import_set_state_nolock()) 000000008e5e499b lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787868567.374708:0:3635:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b8d67aa9): req@000000005a8d42b7 x1874715939451648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868567.374722:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939451136:0@lo:38: 00000100:00100000:3.0:1787868567.376794:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868567.376848:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8d67aa9 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.379979:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939451648 00000100:00100000:1.0:1787868567.379995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939451648 00000100:00100000:1.0:1787868567.380052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868567.380061:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000471fa725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939451648:12345-0@lo:1000: 00000100:00100000:1.0:1787868567.380212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000471fa725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939451648:12345-0@lo:1000: Request processed in 153us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.380220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868567.380549:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a8d42b7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939451648:0@lo:1000: 00000040:01000000:3.0:1787868567.380593:0:7740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787868567.380634:0:7740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452160:0@lo:1000: 00000100:00100000:3.0:1787868567.380678:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868567.380719:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60a7a8b going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.380781:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452160 00000100:00100000:1.0:1787868567.380796:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452160 00000100:00100000:1.0:1787868567.380829:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868567.380835:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009febd7b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939452160:12345-0@lo:1000: 00000100:00100000:1.0:1787868567.380932:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009febd7b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939452160:12345-0@lo:1000: Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.380939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868567.381007:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452160:0@lo:1000: 00000100:00100000:3.0:1787868567.381043:0:7740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452288:0@lo:700: 00000100:00100000:3.0:1787868567.381067:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868567.381090:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7405ff8 going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.381260:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452288 00000100:00100000:1.0:1787868567.381265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452288 00000100:00100000:1.0:1787868567.381288:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868567.381294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050462db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939452288:12345-0@lo:700: 00000100:00100000:1.0:1787868567.381331:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050462db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7740:x1874715939452288:12345-0@lo:700: Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.381336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868567.381450:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452288:0@lo:700: 00000100:00100000:3.0:1787868567.381558:0:7740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452416:0@lo:1000: 00000100:00100000:3.0:1787868567.381587:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868567.381611:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dbbcf5 going to sleep for 11 seconds 00000100:00100000:3.0:1787868567.381846:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ede73c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939452544:0@lo:41: 00000100:00100000:3.0:1787868567.381874:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868567.381955:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452416 00000100:00100000:1.0:1787868567.381960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452416 00000100:00100000:1.0:1787868567.381992:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452544 00000100:00100000:1.0:1787868567.381995:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452544 00000100:00100000:1.0:1787868567.382009:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868567.382015:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1cd9165 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7740:x1874715939452416:12345-0@lo:1000: 00000100:00100000:1.0:1787868567.382077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1cd9165 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7740:x1874715939452416:12345-0@lo:1000: Request processed in 62us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.382083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868567.382096:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868567.382102:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f429dc21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939452544:12345-0@lo:41: 00000004:00000024:1.0:1787868567.382127:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787868567.384436:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052822cd9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452416:0@lo:1000: 00000004:00080000:2.0:1787868567.384513:0:7740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f7405ff8 with version 0 00000020:00100000:2.0:1787868567.384537:0:7740:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787868567.384543:0:7740:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000087d8956 x1874715939452800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868567.384561:0:7740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000087d8956 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452800:0@lo:1000: 00000100:00100000:2.0:1787868567.384635:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868567.384665:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f668abe going to sleep for 11 seconds 00000100:00100000:2.0:1787868567.384686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452800 00000100:00100000:2.0:1787868567.384692:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452800 00000100:00100000:2.0:1787868567.384726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868567.384733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e51d57d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7740:x1874715939452800:12345-0@lo:1000: 00000100:00100000:1.0:1787868567.389761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f429dc21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1874715939452544:12345-0@lo:41: Request processed in 7651us (7878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.389789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868567.396311:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ede73c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939452544:0@lo:41: 00000001:00080000:1.0:1787868567.406662:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787868567.406675:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787868567.407032:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e51d57d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7740:x1874715939452800:12345-0@lo:1000: Request processed in 22172us (22270us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787868567.407045:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787868567.407190:0:7740:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787868567.407195:0:7740:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787868567.407215:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000087d8956 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452800:0@lo:1000: 00000100:00100000:3.0:1787868567.407304:0:7740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e61ee107 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452928:0@lo:1000: 00000100:00100000:3.0:1787868567.407346:0:7740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868567.407390:0:7740:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c60a7a8b going to sleep for 11 seconds 00000100:00100000:1.0:1787868567.407496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939452928 00000100:00100000:1.0:1787868567.407503:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939452928 00000100:00100000:1.0:1787868567.407541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868567.407549:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003983b8d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7740:x1874715939452928:12345-0@lo:1000: 00000100:00100000:1.0:1787868567.407628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003983b8d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7740:x1874715939452928:12345-0@lo:1000: Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868567.407635:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787868567.407737:0:7740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e61ee107 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1874715939452928:0@lo:1000: 00000040:00080000:0.0:1787868567.407755:0:7740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787868567.407864:0:7740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000bcdcd5db with version 1 00000004:00080000:1.0:1787868567.408351:0:7738:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a51d2fb9 version 1 rpc_version 1 00000020:00100000:1.0:1787868567.408373:0:7738:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787868567.408379:0:7738:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003a6c5536 x1874715939453184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868567.408396:0:7738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7738:1874715939453184:0@lo:1000: 00000100:00100000:1.0:1787868567.408443:0:7738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868567.408466:0:7738:0:(client.c:2715:ptlrpc_set_wait()) set 000000002be2e9dd going to sleep for 11 seconds 00000040:00080000:0.0:1787868567.411030:0:7740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787868567.411125:0:7740:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787868567.411131:0:7740:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1787868567.411275:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453184 00000100:00100000:0.0:1787868567.411306:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453184 00000100:00100000:0.0:1787868567.411374:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787868567.411384:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a8d42b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7738:x1874715939453184:12345-0@lo:1000: 00000001:00080000:2.0:1787868567.420443:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787868567.425182:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a8d42b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7738:x1874715939453184:12345-0@lo:1000: Request processed in 13771us (16711us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787868567.425200:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1787868567.425416:0:7738:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787868567.425422:0:7738:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787868567.425439:0:7738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a6c5536 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7738:1874715939453184:0@lo:1000: 00010000:00010000:3.0:1787868567.654911:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787868567.853036:0:7771:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868567.853774:0:7771:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787868568.673721:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868569.697568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868570.724475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868571.038992:0:7872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868571.039719:0:7872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868571.745323:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868571.938414:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868571.939385:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056357dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939453312:0@lo:41: 00000100:00100000:3.0:1787868571.939476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868571.943104:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453312 00000100:00100000:2.0:1787868571.943120:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453312 00000100:00100000:3.0:1787868571.943463:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787868571.943473:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000852c3219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939453312:12345-0@lo:41: 00000004:00000024:3.0:1787868571.943523:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787868571.943616:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000852c3219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939453312:12345-0@lo:41: Request processed in 145us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868571.943624:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868571.943696:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056357dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939453312:0@lo:41: 00000020:00000080:2.0:1787868572.129969:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2a528a40 20000000:00000080:2.0:1787868572.129987:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93dab6e90000 uarg=0000000000000000 20000000:01000000:2.0:1787868572.130032:0:7920:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787868572.130040:0:7920:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787868572.130044:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787868572.130139:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787868572.130173:0:7920:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787868572.136549:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868572.136810:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787868572.136845:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787868572.136860:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787868572.136876:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787868572.136893:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.136914:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.136921:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.136928:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.137036:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.137072:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 17 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868572.137085:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a62e233e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874715939453440:0@lo:104: 00000100:00100000:3.0:1787868572.137184:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868572.137353:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787868572.137357:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.137368:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868572.137372:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453440 00000100:00100000:1.0:1787868572.137382:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453440 00000100:00100000:1.0:1787868572.137448:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868572.137458:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050b9cc63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:7920:x1874715939453440:12345-0@lo:104: 00010000:00010000:1.0:1787868572.137471:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868572.137475:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053dc5ac3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874715939453568:0@lo:104: 00000100:00100000:3.0:1787868572.137507:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868572.137520:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d425993f going to sleep for 11 seconds 00010000:00010000:1.0:1787868572.137565:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868572.137572:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050b9cc63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:7920:x1874715939453440:12345-0@lo:104: Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868572.137580:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868572.137591:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a62e233e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874715939453440:0@lo:104: 00000100:00100000:1.0:1787868572.137629:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453568 00000100:00100000:1.0:1787868572.137633:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453568 00000100:00100000:1.0:1787868572.137652:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868572.137658:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a592765 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:7920:x1874715939453568:12345-0@lo:104: 00010000:00010000:1.0:1787868572.137666:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.137724:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787868572.137729:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a592765 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:7920:x1874715939453568:12345-0@lo:104: Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868572.137735:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787868572.137743:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868572.137752:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.137754:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868572.137765:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a9561db already unused, calling callback (00000000f6284d2a) 10000000:00010000:2.0:1787868572.137770:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868572.137778:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868572.137785:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868572.137791:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787868572.138027:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053dc5ac3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874715939453568:0@lo:104: 00010000:00010000:3.0:1787868572.138058:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.140371:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.140488:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787868572.140534:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053dc5ac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939453696:0@lo:103: 00000100:00100000:2.0:1787868572.140600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868572.140717:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.140726:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000007a9561db/0x2f11f4d3bde2ccc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cccd expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868572.140755:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868572.140758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868572.140759:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868572.140794:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453696 00000100:00100000:0.0:1787868572.140802:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453696 00010000:00010000:0.0:1787868572.140832:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 18 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868572.140896:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787868572.140905:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e567b53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3638:x1874715939453696:12345-0@lo:103: 00010000:00010000:0.0:1787868572.140920:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868572.140924:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 18 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868572.140936:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 18 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868572.140969:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4320dad/0x2f11f4d3bde2cccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccc6 expref: 18 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868572.140985:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868572.141186:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e567b53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3638:x1874715939453696:12345-0@lo:103: Request processed in 251us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868572.141194:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787868572.147334:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868572.147347:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.147360:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093ba6007 already unused, calling callback (00000000f6284d2a) 10000000:00010000:1.0:1787868572.147364:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.147373:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868572.147380:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868572.147394:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787868572.148128:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.148138:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868572.148188:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.148197:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000093ba6007/0x2f11f4d3bde2cbd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cbdf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.148223:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868572.148226:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868572.148231:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868572.148249:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9034acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939453824:0@lo:103: 00000100:00100000:1.0:1787868572.148319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868572.148403:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453824 00000100:00100000:1.0:1787868572.148410:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453824 00010000:00010000:1.0:1787868572.148437:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868572.148479:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868572.148489:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ea368f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939453824:12345-0@lo:103: 00010000:00010000:1.0:1787868572.150110:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868572.150120:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150136:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150186:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ccbb09a/0x2f11f4d3bde2cbdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cbd8 expref: 17 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150204:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150212:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150229:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150236:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150242:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150248:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150254:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098881ac7 already unused, calling callback (000000002ccb6f0c) 00010000:00010000:1.0:1787868572.150258:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150264:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150286:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868572.150309:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868572.150379:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053dc5ac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939453696:0@lo:103: 00010000:00010000:0.0:1787868572.150849:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868572.150853:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868572.151908:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ea368f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939453824:12345-0@lo:103: Request processed in 3414us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868572.151924:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787868572.151958:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9034acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939453824:0@lo:103: 00010000:00010000:2.0:1787868572.152125:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868572.152137:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868572.152174:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098881ac7/0x2f11f4d3bde2cd60 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868572.449669:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030f9712e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939453952:0@lo:41: 00000100:00100000:2.0:1787868572.449749:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868572.449845:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939453952 00000100:00100000:2.0:1787868572.449853:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939453952 00000100:00100000:2.0:1787868572.449907:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787868572.449916:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000194cf412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939453952:12345-0@lo:41: 00000004:00000024:2.0:1787868572.449953:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787868572.450001:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000194cf412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939453952:12345-0@lo:41: Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868572.450008:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787868572.450070:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030f9712e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939453952:0@lo:41: 00000100:00100000:3.0:1787868572.450995:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000069c912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939454080:0@lo:400: 00000100:00100000:1.0:1787868572.450998:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939454208:0@lo:400: 00000100:00100000:3.0:1787868572.451131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868572.451597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454080 00000100:00100000:1.0:1787868572.451620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454080 00000100:00100000:1.0:1787868572.451672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868572.451680:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a62e233e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939454080:12345-0@lo:400: 00000100:00100000:1.0:1787868572.451773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a62e233e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939454080:12345-0@lo:400: Request processed in 94us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868572.451781:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868572.451803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868572.451845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454208 00000100:00100000:1.0:1787868572.451848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454208 00000100:00100000:1.0:1787868572.451876:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868572.451881:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb46d040 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939454208:12345-0@lo:400: 00000100:00100000:1.0:1787868572.451921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb46d040 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939454208:12345-0@lo:400: Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868572.451927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787868572.452038:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000031ae5d36 x1874715939454208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868572.452064:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031ae5d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939454208:0@lo:400: 00010000:00080000:2.0:1787868572.463021:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000069c912e x1874715939454080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868572.463057:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000069c912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939454080:0@lo:400: 00010000:00010000:3.0:1787868572.770032:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868573.793534:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787868574.753277:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868574.753288:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daaf704800 from 1 10000000:01000000:0.0:1787868574.753294:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868574.753341:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000074d514a8/0x2f11f4d3bde2cd67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.753355:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000074d514a8/0x2f11f4d3bde2cd67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.753366:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000074d514a8/0x2f11f4d3bde2cd67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868574.753393:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454336:0@lo:101: 00000100:00100000:0.0:1787868574.753497:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.753571:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f9d5ffc going to sleep for 11 seconds 00000100:00100000:1.0:1787868574.754206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454336 00000100:00100000:1.0:1787868574.754216:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454336 00000100:00100000:1.0:1787868574.754277:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787868574.754286:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe29327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939454336:12345-0@lo:101: 00010000:00010000:1.0:1787868574.754301:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868574.754333:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a39eb596/0x2f11f4d3bde2cd6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd67 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.754359:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a39eb596/0x2f11f4d3bde2cd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.754370:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a39eb596/0x2f11f4d3bde2cd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.754378:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a39eb596, rc 0) 00000100:00100000:1.0:1787868574.754430:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe29327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454336:12345-0@lo:101: Request processed in 146us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868574.754437:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787868574.754592:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e4e964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454336:0@lo:101: 00010000:00010000:2.0:1787868574.754608:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000074d514a8/0x2f11f4d3bde2cd67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868574.754617:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000074d514a8/0x2f11f4d3bde2cd67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868574.754696:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0209b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454464:0@lo:501: 00000100:00100000:2.0:1787868574.754743:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868574.754785:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000423843a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787868574.756201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454464 00000100:00100000:1.0:1787868574.756212:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454464 00000100:00100000:1.0:1787868574.756262:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868574.756269:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4fc552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454464:12345-0@lo:501: 00000100:00100000:0.0:1787868574.756485:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4fc552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454464:12345-0@lo:501: Request processed in 216us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.756493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868574.757062:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0209b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454464:0@lo:501: 00000100:00100000:1.0:1787868574.757291:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005976cb21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454592:0@lo:503: 00000100:00100000:1.0:1787868574.757345:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868574.757377:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e29ac187 going to sleep for 11 seconds 00000100:00100000:0.0:1787868574.762783:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454592 00000100:00100000:0.0:1787868574.762802:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454592 00000100:00100000:0.0:1787868574.762868:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787868574.762878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c4a9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454592:12345-0@lo:503: 00000100:00100000:0.0:1787868574.763082:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c4a9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454592:12345-0@lo:503: Request processed in 205us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.763091:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787868574.763339:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005976cb21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454592:0@lo:503: 00000100:00100000:0.0:1787868574.767378:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8001:1874715939454720:0@lo:502: 00000100:00100000:0.0:1787868574.767886:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.768006:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c2f096b going to sleep for 11 seconds 00000100:00100000:1.0:1787868574.777839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454720 00000100:00100000:1.0:1787868574.777859:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454720 00000100:00100000:0.0:1787868574.778026:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787868574.778047:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fa3b6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8001:x1874715939454720:12345-0@lo:502: 00000100:00100000:0.0:1787868574.778296:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fa3b6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8001:x1874715939454720:12345-0@lo:502: Request processed in 252us (10410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.778306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787868574.778515:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc0d7517 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8001:1874715939454720:0@lo:502: 00000020:01000000:3.0:1787868574.778565:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868574.778576:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868574.778579:0:8001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787868574.778587:0:8001:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daaf704800 00000020:00000080:3.0:1787868574.778590:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787868574.778654:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8001:1874715939454848:0@lo:502: 00000100:00100000:3.0:1787868574.778702:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868574.778746:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868574.779046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454848 00000100:00100000:0.0:1787868574.779052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454848 00000100:00100000:0.0:1787868574.779092:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787868574.779101:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8001:x1874715939454848:12345-0@lo:502: 00000100:00100000:0.0:1787868574.779206:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8001:x1874715939454848:12345-0@lo:502: Request processed in 105us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.779213:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787868574.779377:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8001:1874715939454848:0@lo:502: 00000020:01000000:3.0:1787868574.779401:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868574.779407:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868574.779410:0:8001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787868574.779413:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787868574.780584:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787868574.780613:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868574.780625:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.780658:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868574.780670:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868574.780673:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05d8800 from 1 10000000:01000000:0.0:1787868574.780677:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868574.780726:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.780735:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.780745:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868574.780765:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454976:0@lo:101: 00000100:00100000:0.0:1787868574.780827:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.780870:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868574.781221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939454976 00000100:00100000:1.0:1787868574.781228:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939454976 00000100:00100000:1.0:1787868574.781275:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787868574.781285:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939454976:12345-0@lo:101: 00010000:00010000:1.0:1787868574.781299:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868574.781322:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd75 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.781346:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.781356:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868574.781365:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b200, rc 0) 00000100:00100000:1.0:1787868574.781410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939454976:12345-0@lo:101: Request processed in 127us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868574.781417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787868574.781802:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939454976:0@lo:101: 00010000:00010000:0.0:1787868574.781820:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.781829:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868574.781904:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939455104:0@lo:501: 00000100:00100000:0.0:1787868574.781940:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.781968:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787868574.782255:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455104 00000100:00100000:3.0:1787868574.782261:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455104 00000100:00100000:3.0:1787868574.782291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787868574.782306:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939455104:12345-0@lo:501: 00000100:00100000:3.0:1787868574.782423:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939455104:12345-0@lo:501: Request processed in 118us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868574.782430:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787868574.784668:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939455104:0@lo:501: 00000100:00100000:0.0:1787868574.784742:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939455232:0@lo:503: 00000100:00100000:0.0:1787868574.784932:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.784973:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787868574.785426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455232 00000100:00100000:3.0:1787868574.785441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455232 00000100:00100000:3.0:1787868574.785489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868574.785498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939455232:12345-0@lo:503: 00000100:00100000:3.0:1787868574.785629:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939455232:12345-0@lo:503: Request processed in 132us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868574.785637:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787868574.786863:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939455232:0@lo:503: 00000100:00100000:0.0:1787868574.798207:0:8002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8002:1874715939455360:0@lo:502: 00000100:00100000:0.0:1787868574.798295:0:8002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.798341:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455360 00000100:00100000:0.0:1787868574.798348:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455360 00000100:00100000:0.0:1787868574.798397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787868574.798406:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8002:x1874715939455360:12345-0@lo:502: 00000100:00100000:0.0:1787868574.798535:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8002:x1874715939455360:12345-0@lo:502: Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.798542:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787868574.798594:0:8002:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868574.798616:0:8002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8002:1874715939455360:0@lo:502: 00000020:01000000:0.0:1787868574.798647:0:8002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868574.798658:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868574.798661:0:8002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787868574.798667:0:8002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daa05d8800 00000020:00000080:0.0:1787868574.798670:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787868574.798690:0:8002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8002:1874715939455488:0@lo:502: 00000100:00100000:0.0:1787868574.798734:0:8002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868574.798757:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455488 00000100:00100000:0.0:1787868574.798760:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455488 00000100:00100000:0.0:1787868574.798795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787868574.798803:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8002:x1874715939455488:12345-0@lo:502: 00000100:00100000:0.0:1787868574.798863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8002:x1874715939455488:12345-0@lo:502: Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868574.798869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787868574.798894:0:8002:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868574.798905:0:8002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8002:1874715939455488:0@lo:502: 00000020:01000000:0.0:1787868574.798923:0:8002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868574.798926:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868574.798928:0:8002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787868574.798931:0:8002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787868574.798985:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787868574.799015:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868574.799026:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.799037:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868574.817286:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868575.841473:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868576.868955:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868577.062667:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939455616:0@lo:41: 00000100:00100000:1.0:1787868577.062773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868577.063233:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455616 00000100:00100000:3.0:1787868577.063245:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455616 00000100:00100000:3.0:1787868577.063313:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868577.063325:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939455616:12345-0@lo:41: 00000004:00000024:3.0:1787868577.063373:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787868577.070461:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939455616:12345-0@lo:41: Request processed in 7121us (7671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868577.070485:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787868577.073424:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939455616:0@lo:41: 00000100:00100000:1.0:1787868577.569954:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939455744:0@lo:400: 00000100:00100000:3.0:1787868577.569997:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939456128:0@lo:400: 00000100:00100000:2.0:1787868577.570116:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939455872:0@lo:400: 00000100:00100000:0.0:1787868577.570143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939456000:0@lo:400: 00000100:00100000:3.0:1787868577.576210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868577.577917:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868577.578197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868577.578345:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456128 00000100:00100000:2.0:1787868577.578356:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456128 00000100:00100000:2.0:1787868577.578414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787868577.578426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939456128:12345-0@lo:400: 00000100:00100000:2.0:1787868577.578522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939456128:12345-0@lo:400: Request processed in 98us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868577.578530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787868577.578840:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868577.578855:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939456256:0@lo:41: 00000100:00100000:2.0:1787868577.578906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868577.578927:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455744 00000100:00100000:3.0:1787868577.578933:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455744 00000100:00100000:3.0:1787868577.579045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787868577.579055:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3636:x1874715939455744:12345-0@lo:400: 00000100:00100000:3.0:1787868577.579097:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3636:x1874715939455744:12345-0@lo:400: Request processed in 45us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868577.579113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787868577.579801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868577.580775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939455872 00000100:00100000:2.0:1787868577.580790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939455872 00000100:00100000:2.0:1787868577.580856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456000 00000100:00100000:2.0:1787868577.580860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456000 00000100:00100000:2.0:1787868577.580877:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868577.580887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939455872:12345-0@lo:400: 00000100:00100000:3.0:1787868577.580967:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456256 00000100:00100000:2.0:1787868577.580994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939455872:12345-0@lo:400: Request processed in 108us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868577.581001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868577.581018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868577.581025:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939456000:12345-0@lo:400: 00000100:00100000:3.0:1787868577.581029:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456256 00000100:00100000:2.0:1787868577.581062:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939456000:12345-0@lo:400: Request processed in 37us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868577.581064:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868577.581068:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787868577.581072:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939456256:12345-0@lo:41: 00000004:00000024:3.0:1787868577.581104:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00010000:00080000:2.0:1787868577.581116:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f1c3c0 x1874715939456000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868577.581133:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939456000:0@lo:400: 00000100:00100000:3.0:1787868577.581143:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939456256:12345-0@lo:41: Request processed in 73us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868577.581150:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868577.581210:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939456128:0@lo:400: 00000100:00100000:2.0:1787868577.581216:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939456256:0@lo:41: 00010000:00080000:2.0:1787868577.581236:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f1cf00 x1874715939455872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868577.581248:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939455872:0@lo:400: 00000100:00100000:1.0:1787868577.583004:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939455744:0@lo:400: 00010000:00010000:0.0:1787868577.890006:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868578.915344:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868579.938939:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868580.961804:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868581.988482:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868582.177403:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939456384:0@lo:41: 00000100:00100000:0.0:1787868582.177488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868582.177744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456384 00000100:00100000:2.0:1787868582.177753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456384 00000100:00100000:2.0:1787868582.177806:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787868582.177815:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939456384:12345-0@lo:41: 00000004:00000024:2.0:1787868582.177848:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787868582.177931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939456384:12345-0@lo:41: Request processed in 116us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868582.177939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787868582.178089:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939456384:0@lo:41: 00000100:00100000:2.0:1787868582.690140:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939456512:0@lo:400: 00000100:00100000:2.0:1787868582.690257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868582.690319:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868582.690327:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939456640:0@lo:400: 00000100:00100000:2.0:1787868582.690356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868582.690437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456640 00000100:00100000:2.0:1787868582.690446:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456640 00000100:00100000:2.0:1787868582.690494:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868582.690503:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939456640:12345-0@lo:400: 00000100:00100000:2.0:1787868582.690556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939456640:12345-0@lo:400: Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868582.690563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868582.690592:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939457024:0@lo:41: 00000100:00100000:2.0:1787868582.690638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787868582.690684:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f1c780 x1874715939456640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868582.690699:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939456640:0@lo:400: 00000100:00100000:3.0:1787868582.690996:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456512 00000100:00100000:3.0:1787868582.691002:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456512 00000100:00100000:3.0:1787868582.691042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787868582.691052:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3638:x1874715939456512:12345-0@lo:400: 00000100:00100000:3.0:1787868582.691103:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3638:x1874715939456512:12345-0@lo:400: Request processed in 54us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868582.691109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787868582.691138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457024 00000100:00100000:3.0:1787868582.691141:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457024 00000100:00100000:3.0:1787868582.691193:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787868582.691201:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939457024:12345-0@lo:41: 00000100:00100000:1.0:1787868582.691952:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939456768:0@lo:400: 00000100:00100000:1.0:1787868582.691997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868582.692039:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868582.692047:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939456896:0@lo:400: 00000100:00100000:1.0:1787868582.692080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868582.692084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456768 00000004:00000024:3.0:1787868582.692090:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787868582.692091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456768 00000100:00100000:2.0:1787868582.692132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868582.692142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939456768:12345-0@lo:400: 00000100:00100000:3.0:1787868582.692144:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939457024:12345-0@lo:41: Request processed in 941us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868582.692178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787868582.692193:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939456896 00000100:00100000:1.0:1787868582.692198:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939456896 00000100:00100000:2.0:1787868582.692216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939456768:12345-0@lo:400: Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868582.692234:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868582.692236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868582.692245:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939456896:12345-0@lo:400: 00000100:00100000:1.0:1787868582.692289:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939456896:12345-0@lo:400: Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868582.692295:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787868582.692322:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939456896:0@lo:400: 00010000:00080000:1.0:1787868582.692332:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f1e580 x1874715939456768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868582.692341:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939456768:0@lo:400: 00000100:00100000:3.0:1787868582.692623:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939457024:0@lo:41: 00000100:00100000:3.0:1787868582.692642:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939456512:0@lo:400: 00010000:00010000:3.0:1787868583.009739:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787868583.012951:0:8422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787868583.012955:0:8422:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787868583.012956:0:8422:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787868583.013106:0:8422:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93dab5b24800 00000020:01000004:1.0:1787868583.013123:0:8422:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787868583.013135:0:8422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787868583.013148:0:8422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93daaf714ed8) 00000020:00000080:1.0:1787868583.013181:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787868583.059422:0:8422:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787868583.059477:0:8422:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1787868583.078833:0:8422:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787868583.079116:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787868583.079127:0:8422:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787868583.079138:0:8422:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2cd8a 00000020:01000004:3.0:1787868583.079145:0:8422:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787868583.079318:0:8422:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787868583.079322:0:8422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787868583.079329:0:8422:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787868583.079335:0:8422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787868583.079347:0:8422:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93dabda58000) 00000020:00000080:3.0:1787868583.079358:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1787868583.085586:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868583.085777:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787868583.085784:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787868583.090054:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787868583.090067:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787868583.098483:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787868583.098635:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787868583.107651:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787868583.110070:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787868583.110080:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787868583.114887:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787868583.114899:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787868583.154502:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868583.154738:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787868583.154746:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787868583.161750:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787868583.161767:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787868583.164916:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787868583.164996:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787868583.175470:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868583.176052:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787868583.176059:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787868583.177018:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787868583.177027:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787868583.277180:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868583.277383:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787868583.277390:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787868583.280808:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787868583.280826:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787868583.281742:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787868583.281778:0:8422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787868583.281784:0:8422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787868583.328949:0:8422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787868583.328987:0:8422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787868583.328992:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787868583.328993:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787868583.328995:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868583.329000:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868583.329001:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868583.329002:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868583.329004:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868583.329005:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787868583.329007:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787868583.329008:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868583.329009:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868583.329013:0:8422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787868583.329015:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787868583.329016:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787868583.329017:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868583.329018:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868583.329019:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868583.329020:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868583.329021:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868583.329022:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787868583.329023:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787868583.329024:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868583.329025:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787868583.336500:0:8422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787868583.336526:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939457152:0@lo:253: 00000100:00100000:2.0:1787868583.336623:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.336685:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868583.336773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457152 00000100:00100000:0.0:1787868583.336781:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457152 00000100:00100000:0.0:1787868583.336848:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787868583.336859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8422:x1874715939457152:12345-0@lo:253: 20000000:01000000:0.0:1787868583.336908:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787868583.336923:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787868583.336934:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787868583.336937:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787868583.337250:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868583.337414:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787868583.337430:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787868583.337446:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787868583.337452:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787868583.337463:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787868583.337477:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787868583.337559:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787868583.337575:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1787868583.337577:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787868583.337591:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787868583.337597:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787868583.337609:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787868583.337615:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1787868583.337626:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787868583.337631:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787868583.337642:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787868583.337656:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787868583.337729:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787868583.337739:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1787868583.337741:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787868583.337768:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787868583.337774:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787868583.337785:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787868583.337789:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1787868583.337799:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787868583.337803:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787868583.337814:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787868583.337827:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787868583.338216:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787868583.338228:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1787868583.338230:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787868583.338243:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787868583.338248:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787868583.338260:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787868583.338266:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1787868583.338278:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787868583.338283:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787868583.338299:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787868583.338312:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787868583.338322:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787868583.338325:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787868583.338328:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787868583.338368:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787868583.338370:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787868583.339377:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787868583.339570:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787868583.339595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787868583.339610:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787868583.339619:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787868583.339621:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868583.340442:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868583.340467:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868583.340478:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787868583.340664:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787868583.340684:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787868583.340698:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787868583.340707:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787868583.340709:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787868583.341528:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1787868583.341572:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1787868583.341589:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787868583.341764:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787868583.341784:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787868583.341800:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1787868583.341809:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787868583.341812:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868583.342364:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868583.342392:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868583.342404:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787868583.342519:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787868583.342533:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787868583.342555:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1787868583.342573:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787868583.342594:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342611:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342619:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342626:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342633:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342640:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342658:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342697:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342711:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 18 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.342725:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457280:0@lo:104: 00000100:00100000:3.0:1787868583.342791:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868583.342879:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.342888:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.342897:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457408:0@lo:104: 00000100:00100000:1.0:1787868583.343102:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457280 00000100:00100000:1.0:1787868583.343109:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457280 00000100:00100000:1.0:1787868583.343173:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868583.343183:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939457280:12345-0@lo:104: 00010000:00010000:1.0:1787868583.343194:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.343239:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868583.343244:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939457280:12345-0@lo:104: Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.343251:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868583.343388:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868583.343440:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.343448:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 18 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.343457:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457536:0@lo:104: 00000100:00100000:3.0:1787868583.343477:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868583.343500:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.343512:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.343519:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457664:0@lo:104: 00000100:00100000:3.0:1787868583.343537:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.343725:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457408 00000100:00100000:2.0:1787868583.343730:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457408 00000100:00100000:2.0:1787868583.343750:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457536 00000100:00100000:2.0:1787868583.343752:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457536 00000100:00100000:2.0:1787868583.343760:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457664 00000100:00100000:2.0:1787868583.343763:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457664 00000100:00100000:2.0:1787868583.343772:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868583.343779:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6507:x1874715939457408:12345-0@lo:104: 00010000:00010000:2.0:1787868583.343787:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.343840:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787868583.343846:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6507:x1874715939457408:12345-0@lo:104: Request processed in 68us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.343852:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868583.343865:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868583.343871:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6507:x1874715939457536:12345-0@lo:104: 00010000:00010000:2.0:1787868583.343879:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.343909:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787868583.343926:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6507:x1874715939457536:12345-0@lo:104: Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.344051:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868583.344065:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868583.344072:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939457664:12345-0@lo:104: 00010000:00010000:2.0:1787868583.344079:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344123:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787868583.344129:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939457664:12345-0@lo:104: Request processed in 58us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.344135:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787868583.344150:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787868583.344178:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344184:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.344187:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344195:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868583.344202:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.344207:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.344233:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344238:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.344255:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344261:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2cd52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344282:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787868583.344284:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344289:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.344291:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344297:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868583.344302:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.344307:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.344317:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344322:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.344334:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344339:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2cd28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344346:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868583.344349:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344360:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.344363:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344368:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868583.344373:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.344377:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.344387:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344391:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.344395:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344400:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cd0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344407:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868583.344410:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344414:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20ffe00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.344416:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344429:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868583.344434:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.344438:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.344448:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344454:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.344458:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344463:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac20ffe00/0x2f11f4d3bde2ccd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ccdb expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.344473:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.344474:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.344475:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.344482:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868583.344500:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939457792:0@lo:103: 00000100:00100000:2.0:1787868583.344529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868583.346350:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868583.346516:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.346532:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.346549:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939458304:0@lo:104: 00000100:00100000:3.0:1787868583.346598:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868583.346618:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa0f3dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868583.346641:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457280:0@lo:104: 00000100:00100000:3.0:1787868583.346652:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457408:0@lo:104: 00000100:00100000:3.0:1787868583.346660:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457536:0@lo:104: 00000100:00100000:3.0:1787868583.346668:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939457664:0@lo:104: 00000100:00100000:1.0:1787868583.347112:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458304 00000100:00100000:1.0:1787868583.347119:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458304 00000100:00100000:1.0:1787868583.347179:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868583.347188:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939458304:12345-0@lo:104: 00010000:00010000:1.0:1787868583.347213:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.347267:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868583.347272:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6507:x1874715939458304:12345-0@lo:104: Request processed in 87us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.347278:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868583.347403:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868583.347412:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939458176:0@lo:103: 00000100:00100000:2.0:1787868583.347439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.347477:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939457920:0@lo:103: 00000100:00100000:2.0:1787868583.347496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.347521:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868583.347526:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939458048:0@lo:103: 00000100:00100000:2.0:1787868583.347553:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.347581:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457792 00000100:00100000:2.0:1787868583.347585:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457792 00010000:00010000:2.0:1787868583.347605:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 19 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.347619:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458176 00000100:00100000:2.0:1787868583.347621:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458176 00010000:00010000:2.0:1787868583.347632:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 20 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.347641:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939457920 00000100:00100000:2.0:1787868583.347644:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939457920 00010000:00010000:2.0:1787868583.347654:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 21 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.347664:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458048 00000100:00100000:2.0:1787868583.347666:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458048 00010000:00010000:2.0:1787868583.347676:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 22 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.347686:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868583.347692:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:3639:x1874715939457792:12345-0@lo:103: 00010000:00010000:2.0:1787868583.347703:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868583.347708:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 22 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347717:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 22 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347746:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2cd59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd52 expref: 22 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347760:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868583.347788:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3639:x1874715939457792:12345-0@lo:103: Request processed in 97us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.347794:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868583.347810:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868583.347815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3639:x1874715939458176:12345-0@lo:103: 00010000:00010000:2.0:1787868583.347846:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868583.347851:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 20 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347861:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 20 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347871:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2ccdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccd4 expref: 20 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.347881:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868583.347904:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3639:x1874715939458176:12345-0@lo:103: Request processed in 89us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.347910:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787868583.348211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787868583.348221:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3636:x1874715939457920:12345-0@lo:103: 00010000:00010000:1.0:1787868583.348231:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868583.348235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348244:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348253:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2cd2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd28 expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348263:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868583.348292:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3636:x1874715939457920:12345-0@lo:103: Request processed in 73us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.348297:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787868583.348311:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868583.348316:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3636:x1874715939458048:12345-0@lo:103: 00010000:00010000:1.0:1787868583.348323:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868583.348326:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348354:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348363:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cd13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd0c expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.348371:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868583.348394:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3636:x1874715939458048:12345-0@lo:103: Request processed in 79us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.348400:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868583.348474:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939458048:0@lo:103: 00000100:00100000:0.0:1787868583.348483:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939457920:0@lo:103: 00000100:00100000:3.0:1787868583.348629:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874715939458304:0@lo:104: 00010000:00010000:3.0:1787868583.348657:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.348821:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868583.348829:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.348846:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.348856:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.348865:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868583.348872:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.348878:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.348969:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.348975:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.348992:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.348999:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2cc5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cc64 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.349011:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.349013:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.349015:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868583.349027:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939458432:0@lo:103: 00000100:00100000:2.0:1787868583.349062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.349116:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939458176:0@lo:103: 00000100:00100000:2.0:1787868583.349125:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939457792:0@lo:103: 00000100:00100000:1.0:1787868583.349443:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458432 00000100:00100000:1.0:1787868583.349448:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458432 00010000:00010000:1.0:1787868583.349472:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 15 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868583.349497:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868583.349502:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3639:x1874715939458432:12345-0@lo:103: 00010000:00010000:1.0:1787868583.349511:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868583.349514:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 15 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349524:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 15 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349538:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cc64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cc5d expref: 15 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349559:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349586:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349602:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349610:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349616:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349622:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349627:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20ffc00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868583.349631:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349637:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349656:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.349664:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868583.349698:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3639:x1874715939458432:12345-0@lo:103: Request processed in 196us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.349704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787868583.349771:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.349778:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.349789:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2cd98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787868583.349801:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787868583.350647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939458432:0@lo:103: 00000100:00100000:3.0:1787868583.354789:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:8422:x1874715939457152:12345-0@lo:253: Request processed in 17920us (18154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868583.354804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787868583.355043:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939457152:0@lo:253: 10000000:01000000:2.0:1787868583.355070:0:8422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787868583.355073:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787868583.355075:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787868583.355076:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868583.355077:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787868583.355078:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868583.355079:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868583.355080:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787868583.355082:0:8422:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787868583.355083:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868583.355084:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787868583.355104:0:8422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dab5b24800 from lustre-OST0000 10000000:01000000:2.0:1787868583.355133:0:8422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787868583.355136:0:8422:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787868583.355144:0:8422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93daae688000 local copy 10000000:01000000:2.0:1787868583.355148:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787868583.355286:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.355297:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.355305:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.355322:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458560:0@lo:101: 00000100:00100000:2.0:1787868583.355357:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.355425:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868583.355463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458560 00000100:00100000:3.0:1787868583.355470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458560 00000100:00100000:3.0:1787868583.355553:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787868583.355579:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+13:8422:x1874715939458560:12345-0@lo:101: 00010000:00010000:3.0:1787868583.355591:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868583.355605:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20fec00/0x2f11f4d3bde2cda6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cd9f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.355629:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20fec00/0x2f11f4d3bde2cda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd9f expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.355639:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20fec00/0x2f11f4d3bde2cda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd9f expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.355647:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20fec00, rc 0) 00000100:00100000:3.0:1787868583.355687:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939458560:12345-0@lo:101: Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868583.355692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787868583.355757:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458560:0@lo:101: 00010000:00010000:2.0:1787868583.355770:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.355791:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.355893:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458688:0@lo:501: 00000100:00100000:2.0:1787868583.355920:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.356421:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.356455:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458688 00000100:00100000:1.0:1787868583.356466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458688 00000100:00100000:1.0:1787868583.356490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787868583.356496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939458688:12345-0@lo:501: 00000100:00100000:1.0:1787868583.356683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939458688:12345-0@lo:501: Request processed in 186us (761us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787868583.356690:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787868583.356812:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458688:0@lo:501: 10000000:01000000:2.0:1787868583.356827:0:8422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787868583.356856:0:8422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787868583.356862:0:8422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.356870:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.356877:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.356922:0:8422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787868583.356951:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93dab5b24800 10000000:01000000:2.0:1787868583.356955:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787868583.356960:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787868583.356962:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787868583.356965:0:8422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787868583.356967:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787868583.356992:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.357008:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.357017:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.357029:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458816:0@lo:101: 00000100:00100000:2.0:1787868583.357055:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.357108:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.357308:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458816 00000100:00100000:1.0:1787868583.357313:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458816 00000100:00100000:1.0:1787868583.357370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787868583.357377:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939458816:12345-0@lo:101: 00010000:00010000:1.0:1787868583.357384:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868583.357397:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cdad expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.357415:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.357423:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.357430:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ac00, rc 0) 00000100:00100000:1.0:1787868583.357456:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939458816:12345-0@lo:101: Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.357461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1787868583.357509:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868583.357517:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.357537:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868583.357541:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.357549:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868583.357555:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868583.357579:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.357843:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.357857:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.357880:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.357887:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cd9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cda6 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.357899:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.357900:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.357902:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868583.357909:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868583.357920:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939458944:0@lo:103: 00000100:00100000:2.0:1787868583.357960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.358093:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939458944 00000100:00100000:2.0:1787868583.358097:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939458944 00000100:00100000:2.0:1787868583.358126:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868583.358132:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939458944:12345-0@lo:103: 00010000:00010000:2.0:1787868583.358146:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868583.358182:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20fec00/0x2f11f4d3bde2cda6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd9f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.358192:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868583.358217:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3637:x1874715939458944:12345-0@lo:103: Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.358223:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868583.358252:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939458944:0@lo:103: 00000100:00100000:2.0:1787868583.358277:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939458816:0@lo:101: 00010000:00010000:2.0:1787868583.358289:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.358296:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.358360:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459072:0@lo:501: 00000100:00100000:2.0:1787868583.358385:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.358399:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868583.358412:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459072 00000100:00100000:2.0:1787868583.358416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459072 00000100:00100000:2.0:1787868583.358433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787868583.358439:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459072:12345-0@lo:501: 00000100:00100000:2.0:1787868583.358524:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459072:12345-0@lo:501: Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.358530:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787868583.358555:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459072:0@lo:501: 00000100:00100000:2.0:1787868583.358807:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459200:0@lo:503: 00000100:00100000:2.0:1787868583.358859:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.358875:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868583.358888:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459200 00000100:00100000:2.0:1787868583.358892:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459200 00000100:00100000:2.0:1787868583.358909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787868583.358915:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459200:12345-0@lo:503: 00000100:00100000:2.0:1787868583.359479:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459200:12345-0@lo:503: Request processed in 561us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.359487:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868583.360331:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459200:0@lo:503: 00000040:00080000:3.0:1787868583.360700:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868583.360868:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459328:0@lo:502: 00000100:00100000:3.0:1787868583.361086:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868583.361127:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa0f3dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868583.361443:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459328 00000100:00100000:2.0:1787868583.361449:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459328 00000100:00100000:2.0:1787868583.361481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787868583.361488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459328:12345-0@lo:502: 00000100:00100000:2.0:1787868583.361681:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459328:12345-0@lo:502: Request processed in 192us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.361687:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868583.361904:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459328:0@lo:502: 00000040:00080000:2.0:1787868583.362714:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787868583.362820:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787868583.362845:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787868583.362858:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787868583.362867:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787868583.362877:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787868583.362909:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459456:0@lo:502: 00000100:00100000:2.0:1787868583.363097:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.363211:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868583.363678:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459456 00000100:00100000:0.0:1787868583.363686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459456 00000100:00100000:1.0:1787868583.363963:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787868583.363974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459456:12345-0@lo:502: 00000100:00100000:1.0:1787868583.364397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459456:12345-0@lo:502: Request processed in 424us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.364413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787868583.364540:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459456:0@lo:502: 00000040:00080000:2.0:1787868583.364817:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787868583.364829:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787868583.365455:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787868583.365463:0:8445:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787868583.365470:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868583.365472:0:8445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787868583.365478:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868583.365504:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d9863d1a48) 00000020:00000080:0.0:1787868583.365526:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787868583.365532:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787868583.365703:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab5b24800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787868583.365711:0:8445:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787868583.365718:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2cdc2 00010000:00010000:2.0:1787868583.372530:0:8445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1787868583.373764:0:8445:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787868583.377546:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787868583.378639:0:8445:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787868583.384635:0:8445:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787868583.384820:0:8445:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787868583.392101:0:8445:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787868583.398470:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787868583.398482:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868583.398490:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868583.398493:0:8445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787868583.398497:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868583.398502:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868583.398504:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787868583.398508:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787868583.398510:0:8445:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787868583.398539:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868583.398550:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868583.398552:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787868583.398556:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787868583.403077:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787868583.403129:0:8422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787868583.403173:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.403187:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.403196:0:8422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab5b24800 from 1 10000000:01000000:2.0:1787868583.403199:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868583.403239:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.403248:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.403568:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.403593:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459584:0@lo:101: 00000100:00100000:2.0:1787868583.403665:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.403733:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.403795:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459584 00000100:00100000:1.0:1787868583.403803:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459584 00000100:00100000:1.0:1787868583.404192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868583.404204:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:8422:x1874715939459584:12345-0@lo:101: 00010000:00010000:1.0:1787868583.404219:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868583.404233:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cdc9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.404269:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.404282:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.404290:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1be00, rc 0) 00000100:00100000:1.0:1787868583.404339:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459584:12345-0@lo:101: Request processed in 138us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.404346:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787868583.404466:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459584:0@lo:101: 00010000:00010000:2.0:1787868583.404481:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.404491:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.404591:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459712:0@lo:501: 00000100:00100000:2.0:1787868583.404619:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.405577:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868583.405666:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459712 00000100:00100000:0.0:1787868583.405674:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459712 00000100:00100000:0.0:1787868583.405706:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787868583.405713:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459712:12345-0@lo:501: 00000100:00100000:0.0:1787868583.405850:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459712:12345-0@lo:501: Request processed in 137us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868583.405858:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787868583.406025:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459712:0@lo:501: 00000100:00100000:2.0:1787868583.406065:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459840:0@lo:503: 00000100:00100000:2.0:1787868583.406115:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.406133:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868583.406359:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459840 00000100:00100000:0.0:1787868583.406363:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459840 00000100:00100000:0.0:1787868583.406383:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787868583.406388:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459840:12345-0@lo:503: 00000100:00100000:0.0:1787868583.406470:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459840:12345-0@lo:503: Request processed in 80us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868583.406477:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787868583.407137:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459840:0@lo:503: 00000040:00080000:2.0:1787868583.407473:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787868583.407558:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459968:0@lo:502: 00000100:00100000:2.0:1787868583.407608:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.407643:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.407732:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939459968 00000100:00100000:1.0:1787868583.407738:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939459968 00000100:00100000:1.0:1787868583.407775:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787868583.407784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459968:12345-0@lo:502: 00000100:00100000:1.0:1787868583.407888:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939459968:12345-0@lo:502: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.407895:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787868583.408347:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939459968:0@lo:502: 00000040:00080000:2.0:1787868583.408552:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787868583.408577:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787868583.408600:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460096:0@lo:502: 00000100:00100000:2.0:1787868583.408644:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.408681:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868583.409356:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460096 00000100:00100000:3.0:1787868583.409364:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460096 00000100:00100000:3.0:1787868583.409402:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787868583.409410:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939460096:12345-0@lo:502: 00000100:00100000:3.0:1787868583.409518:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939460096:12345-0@lo:502: Request processed in 109us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868583.409525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787868583.409635:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460096:0@lo:502: 00000040:00080000:0.0:1787868583.409700:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787868583.409718:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787868583.411890:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868583.411902:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868583.411905:0:8449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787868583.411911:0:8449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab5b24800 00000020:00000080:2.0:1787868583.411914:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787868583.412044:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868583.412049:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868583.412050:0:8449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787868583.412054:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787868583.412408:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787868583.412438:0:8422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868583.412462:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.412473:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868583.412522:0:8422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787868583.412525:0:8422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93dab5b24800 10000000:01000000:0.0:1787868583.412528:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93dab5b24800 10000000:01000000:0.0:1787868583.412532:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868583.412536:0:8422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab5b24800 from 1 10000000:01000000:0.0:1787868583.412538:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868583.412572:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.412580:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.412591:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868583.412613:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460224:0@lo:101: 00000100:00100000:0.0:1787868583.412674:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.412716:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.412801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460224 00000100:00100000:1.0:1787868583.412808:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460224 00000100:00100000:1.0:1787868583.412881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787868583.412891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8422:x1874715939460224:12345-0@lo:101: 00010000:00010000:1.0:1787868583.412903:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868583.412915:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cdd7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.412947:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.412957:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.412966:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a400, rc 0) 00000100:00100000:1.0:1787868583.413108:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460224:12345-0@lo:101: Request processed in 218us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.413116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787868583.413385:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460224:0@lo:101: 00010000:00010000:0.0:1787868583.413401:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.413423:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868583.413513:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460352:0@lo:501: 00000100:00100000:0.0:1787868583.413842:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.413872:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868583.413938:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460352 00000100:00100000:2.0:1787868583.413943:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460352 00000100:00100000:2.0:1787868583.414089:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787868583.414099:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460352:12345-0@lo:501: 00000100:00100000:2.0:1787868583.414439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460352:12345-0@lo:501: Request processed in 341us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.414447:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787868583.414632:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460352:0@lo:501: 00000100:00100000:1.0:1787868583.414677:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460480:0@lo:503: 00000100:00100000:1.0:1787868583.414726:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868583.414783:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982281c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868583.414852:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460480 00000100:00100000:3.0:1787868583.414857:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460480 00000100:00100000:3.0:1787868583.414942:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787868583.414952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460480:12345-0@lo:503: 00000100:00100000:3.0:1787868583.415054:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460480:12345-0@lo:503: Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868583.415061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787868583.415124:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460480:0@lo:503: 00000040:00080000:1.0:1787868583.415439:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868583.415513:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460608:0@lo:502: 00000100:00100000:1.0:1787868583.415556:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868583.416085:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982281c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868583.416116:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460608 00000100:00100000:0.0:1787868583.416122:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460608 00000100:00100000:2.0:1787868583.416229:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787868583.416240:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460608:12345-0@lo:502: 00000100:00100000:2.0:1787868583.416356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460608:12345-0@lo:502: Request processed in 119us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.416363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787868583.416505:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460608:0@lo:502: 00000040:00080000:1.0:1787868583.416727:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787868583.416763:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787868583.416777:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787868583.416790:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787868583.416802:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787868583.416814:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787868583.416826:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787868583.416853:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787868583.416867:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787868583.416892:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787868583.416907:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787868583.416921:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787868583.417061:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787868583.417079:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787868583.417092:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787868583.417107:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787868583.417120:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787868583.417132:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787868583.417146:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787868583.417193:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787868583.417211:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787868583.417225:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787868583.417239:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787868583.417364:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787868583.417386:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787868583.417416:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787868583.417431:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787868583.417444:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787868583.417459:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787868583.417472:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787868583.417487:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787868583.417501:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787868583.417514:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787868583.417525:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787868583.417545:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787868583.417557:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787868583.417569:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787868583.417599:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460736:0@lo:502: 00000100:00100000:1.0:1787868583.417652:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868583.417685:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982281c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868583.417759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460736 00000100:00100000:2.0:1787868583.417765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460736 00000100:00100000:2.0:1787868583.417810:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787868583.417819:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460736:12345-0@lo:502: 00000100:00100000:2.0:1787868583.418104:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939460736:12345-0@lo:502: Request processed in 286us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.418112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787868583.418468:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939460736:0@lo:502: 00000040:00080000:2.0:1787868583.418599:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787868583.418617:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787868583.423045:0:8450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787868583.423072:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d986e48000) 00000020:00000080:1.0:1787868583.423098:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787868583.423220:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab5b24800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787868583.423225:0:8450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab5b24800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787868583.423228:0:8450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab5b24800 3 00010000:00080000:1.0:1787868583.423261:0:8450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d986e3e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868583.424857:0:8450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787868583.425071:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787868583.425114:0:8450:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787868583.425128:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2f11f4d3bde2cdec 00000100:00080000:1.0:1787868583.425140:0:8450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868583.425146:0:8450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d986e3e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868583.425205:0:8450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336b480 x1874715939460864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868583.425244:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939460864:0@lo:38: 00000100:00100000:1.0:1787868583.425310:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868583.426009:0:8450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787868583.426215:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460864 00000100:00100000:2.0:1787868583.426223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460864 00000100:00100000:2.0:1787868583.426259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868583.426267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939460864:12345-0@lo:38: 00010000:00080000:2.0:1787868583.426294:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1787868583.426328:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2cdf3 00000004:00100000:2.0:1787868583.426417:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787868583.426451:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93dabec69000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868583.426524:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874715939460864:12345-0@lo:38: Request processed in 256us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.426532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868583.426644:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939460992:0@lo:400: 00000100:00100000:2.0:1787868583.426674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.426737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939460992 00000100:00100000:0.0:1787868583.426742:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939460992 00000100:00100000:0.0:1787868583.426772:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787868583.426779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939460992:12345-0@lo:400: 00000100:00100000:0.0:1787868583.426816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939460992:12345-0@lo:400: Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868583.426823:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787868583.427460:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93da9336b480 x1874715939460864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868583.427473:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868583.427482:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787868583.427490:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787868583.427503:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787868583.427506:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787868583.427513:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939460864:0@lo:38: 00000100:00100000:0.0:1787868583.429076:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939461248:0@lo:400: 00000100:00100000:0.0:1787868583.429143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.429204:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868583.429212:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939461120:0@lo:400: 00000100:00100000:0.0:1787868583.429240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.429282:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939461376:0@lo:400: 00000100:00100000:0.0:1787868583.429306:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.429354:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461248 00000100:00100000:0.0:1787868583.429360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461248 00000100:00100000:0.0:1787868583.429420:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787868583.429437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939461248:12345-0@lo:400: 00000100:00100000:0.0:1787868583.429494:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939461248:12345-0@lo:400: Request processed in 58us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868583.429501:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787868583.429542:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93da9393d2c0 x1874715939461248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868583.429555:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939461248:0@lo:400: 00000100:00100000:1.0:1787868583.429706:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461120 00000100:00100000:1.0:1787868583.429711:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461120 00000100:00100000:1.0:1787868583.429747:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461376 00000100:00100000:1.0:1787868583.429750:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461376 00000100:00100000:1.0:1787868583.429764:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868583.429771:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939461120:12345-0@lo:400: 00000100:00100000:1.0:1787868583.429815:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939461120:12345-0@lo:400: Request processed in 44us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.429821:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868583.429845:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787868583.429851:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939461376:12345-0@lo:400: 00000100:00100000:1.0:1787868583.429883:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939461376:12345-0@lo:400: Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.429890:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787868583.429916:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939461376:0@lo:400: 00000100:00100000:1.0:1787868583.429950:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939461120:0@lo:400: 00000020:01000004:0.0:1787868583.433188:0:8450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787868583.433208:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d9863d4ed8) 00000020:00000080:0.0:1787868583.433232:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787868583.433497:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab5b24800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787868583.433502:0:8450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab5b24800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787868583.433505:0:8450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab5b24800 3 00010000:00080000:0.0:1787868583.433551:0:8450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d986fa6800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00080000:2.0:1787868583.435259:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93da9393e580 x1874715939460992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868583.435278:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939460992:0@lo:400: 00010000:00010000:0.0:1787868583.440019:0:8450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787868583.441061:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787868583.441112:0:8450:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787868583.441125:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2f11f4d3bde2ce01 00000100:00080000:1.0:1787868583.441136:0:8450:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868583.441142:0:8450:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d986fa6800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868583.441204:0:8450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336b480 x1874715939461504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868583.441244:0:8450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787868583.446282:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939461504:0@lo:38: 00000100:00100000:3.0:1787868583.446636:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787868583.447315:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787868583.447624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461504 00000100:00100000:1.0:1787868583.447633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461504 00000100:00100000:1.0:1787868583.447684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868583.447694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939461504:12345-0@lo:38: 00010000:00080000:1.0:1787868583.447728:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1787868583.447766:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2ce08 00000004:00100000:1.0:1787868583.447782:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787868583.447816:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93d986e3d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868583.447907:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874715939461504:12345-0@lo:38: Request processed in 214us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.447916:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1787868583.448106:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787868583.448143:0:8422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868583.448183:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.448195:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868583.448252:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787868583.448254:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868583.448256:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868583.448257:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868583.448258:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868583.448259:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868583.448260:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868583.448267:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868583.448269:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868583.448270:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868583.448272:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868583.448276:0:8422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787868583.448278:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868583.448279:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868583.448280:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868583.448281:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868583.448282:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868583.448283:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868583.448284:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868583.448285:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868583.448286:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868583.448287:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868583.448288:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868583.448308:0:8422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787868583.448323:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939461632:0@lo:253: 00000100:00100000:0.0:1787868583.448377:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868583.448406:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943d80 going to sleep for 11 seconds 00010000:00080000:1.0:1787868583.449123:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93da9336b480 x1874715939461504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868583.449135:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868583.449144:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787868583.449151:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787868583.449183:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787868583.449187:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986fa6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787868583.449193:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939461504:0@lo:38: 00000100:00100000:1.0:1787868583.449225:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461632 00000100:00100000:1.0:1787868583.449230:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461632 00000100:00100000:1.0:1787868583.449269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787868583.449277:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939461632:12345-0@lo:253: 20000000:01000000:1.0:1787868583.449301:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787868583.449323:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787868583.459249:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787868583.459263:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787868583.459445:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787868583.459450:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787868583.459475:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459495:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459518:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459526:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459643:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459656:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 16 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.459671:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939461760:0@lo:104: 00000100:00100000:3.0:1787868583.459747:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868583.459801:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.459810:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 16 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.459818:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939461888:0@lo:104: 00000100:00100000:3.0:1787868583.459857:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868583.459942:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787868583.459961:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868583.459987:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461760 00000100:00100000:1.0:1787868583.459994:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461760 00000100:00100000:1.0:1787868583.460027:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939461888 00000100:00100000:1.0:1787868583.460030:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939461888 00000100:00100000:1.0:1787868583.460045:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868583.460053:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939461760:12345-0@lo:104: 00010000:00010000:1.0:1787868583.460065:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.460128:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868583.460134:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939461760:12345-0@lo:104: Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868583.460140:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868583.460199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868583.460205:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939461888:12345-0@lo:104: 00010000:00010000:1.0:1787868583.460212:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460220:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868583.460227:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460235:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868583.460239:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868583.460242:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868583.460246:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939461888:12345-0@lo:104: Request processed in 42us (285us total) trans 0 rc 0/0 00010000:00010000:0.0:1787868583.460248:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868583.460251:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:00010000:0.0:1787868583.460256:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868583.460261:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.460308:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868583.460308:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460315:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460315:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.460321:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868583.460323:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460330:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460333:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460340:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2cd1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868583.460353:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868583.460355:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868583.460357:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1787868583.460420:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868583.460425:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868583.460441:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460446:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868583.460470:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460478:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2ccfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460492:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.460493:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868583.460495:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868583.460507:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939462016:0@lo:103: 00000100:00100000:2.0:1787868583.460548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.460579:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868583.460587:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939462144:0@lo:103: 00000100:00100000:2.0:1787868583.460607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868583.460631:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462016 00000100:00100000:2.0:1787868583.460635:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462016 00010000:00010000:2.0:1787868583.460653:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 17 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.460670:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462144 00000100:00100000:2.0:1787868583.460673:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462144 00010000:00010000:2.0:1787868583.460690:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868583.460708:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868583.460715:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3637:x1874715939462016:12345-0@lo:103: 00010000:00010000:2.0:1787868583.460725:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868583.460731:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460741:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 18 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460757:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868583.460785:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3637:x1874715939462016:12345-0@lo:103: Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.460792:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868583.460806:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787868583.460812:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939462144:12345-0@lo:103: 00010000:00010000:2.0:1787868583.460819:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868583.460823:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 17 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460843:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 17 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460854:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460862:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787868583.460886:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011054703s 00010000:00010000:2.0:1787868583.460891:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460898:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460905:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460911:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460917:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20ffc00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868583.460921:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460928:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460937:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868583.460944:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868583.460983:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939462144:12345-0@lo:103: Request processed in 171us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.460989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787868583.461020:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939462016:0@lo:103: 00000100:00100000:0.0:1787868583.461020:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939462144:0@lo:103: 00000100:00100000:2.0:1787868583.461085:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:8422:x1874715939461632:12345-0@lo:253: Request processed in 11809us (12708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868583.461100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787868583.461135:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8422:1874715939461632:0@lo:253: 10000000:01000000:0.0:1787868583.461146:0:8422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787868583.461150:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868583.461152:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868583.461174:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868583.461175:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868583.461176:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868583.461178:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868583.461179:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868583.461181:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868583.461183:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868583.461185:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868583.461186:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787868583.461198:0:8422:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787868583.461280:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2cd21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd1a expref: 15 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.461292:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939461760:0@lo:104: 00010000:00010000:3.0:1787868583.461300:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cd05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ccfe expref: 14 pid: 6505 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868583.461318:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939461888:0@lo:104: 00010000:00010000:3.0:1787868583.461401:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.461412:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.461419:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868583.461425:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787868583.466338:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787868583.466508:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787868583.466867:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787868583.467040:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787868583.467282:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787868583.467509:0:8422:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787868583.468989:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787868583.483805:0:8422:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787868583.483816:0:8422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787868583.483871:0:8422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787868583.484032:0:8422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787868583.484057:0:8422:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787868583.484196:0:8422:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787868583.485083:0:8422:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868583.485503:0:8422:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787868584.039211:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868584.330145:0:8506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868584.330460:0:8506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868585.057346:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868586.082505:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868587.108937:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868587.297519:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939462272:0@lo:41: 00000100:00100000:0.0:1787868587.297594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868587.297693:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462272 00000100:00100000:1.0:1787868587.297701:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462272 00000100:00100000:1.0:1787868587.297751:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787868587.297772:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939462272:12345-0@lo:41: 00000004:00000024:1.0:1787868587.297804:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787868587.297958:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939462272:12345-0@lo:41: Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868587.297967:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868587.298042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939462272:0@lo:41: 00000100:00100000:0.0:1787868587.816040:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939462400:0@lo:41: 00000100:00100000:0.0:1787868587.816109:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868587.816196:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462400 00000100:00100000:0.0:1787868587.816203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462400 00000100:00100000:0.0:1787868587.816257:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868587.816267:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939462400:12345-0@lo:41: 00000004:00000024:0.0:1787868587.816312:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787868587.816360:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939462400:12345-0@lo:41: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868587.816368:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868587.816405:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939462400:0@lo:41: 00010000:00010000:1.0:1787868588.132682:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787868588.582306:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787868588.838928:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939462528:0@lo:400: 00000100:00100000:0.0:1787868588.839009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868588.839061:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939463040:0@lo:400: 00000100:00100000:0.0:1787868588.839110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868588.839139:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868588.839146:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939462912:0@lo:400: 00000100:00100000:0.0:1787868588.839211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868588.839258:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462528 00000100:00100000:0.0:1787868588.839266:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462528 00000100:00100000:0.0:1787868588.839313:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787868588.839322:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3637:x1874715939462528:12345-0@lo:400: 00000100:00100000:0.0:1787868588.839372:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:3637:x1874715939462528:12345-0@lo:400: Request processed in 51us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868588.839379:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787868588.839415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463040 00000100:00100000:0.0:1787868588.839418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463040 00000100:00100000:0.0:1787868588.839458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868588.839465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939463040:12345-0@lo:400: 00000100:00100000:0.0:1787868588.839505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939463040:12345-0@lo:400: Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868588.839511:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868588.839548:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939462528:0@lo:400: 00000100:00100000:0.0:1787868588.839560:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939463040:0@lo:400: 00000100:00100000:2.0:1787868588.841231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462912 00000100:00100000:2.0:1787868588.841244:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462912 00000100:00100000:2.0:1787868588.841293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868588.841301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939462912:12345-0@lo:400: 00000100:00100000:2.0:1787868588.841393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939462912:12345-0@lo:400: Request processed in 93us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868588.841400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787868588.841443:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f952c0 x1874715939462912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868588.841460:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939462912:0@lo:400: 00000100:00100000:3.0:1787868588.841688:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939462784:0@lo:400: 00000100:00100000:3.0:1787868588.841738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868588.841806:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939463296:0@lo:400: 00000100:00100000:3.0:1787868588.841844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868588.841871:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787868588.841887:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939462656:0@lo:400: 00000100:00100000:3.0:1787868588.841908:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868588.841934:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939463168:0@lo:400: 00000100:00100000:3.0:1787868588.841959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868588.842035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463296 00000100:00100000:0.0:1787868588.842040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463296 00000100:00100000:0.0:1787868588.842079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462656 00000100:00100000:0.0:1787868588.842082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462656 00000100:00100000:0.0:1787868588.842093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463168 00000100:00100000:0.0:1787868588.842095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463168 00000100:00100000:0.0:1787868588.842110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787868588.842117:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939463296:12345-0@lo:400: 00000100:00100000:0.0:1787868588.842180:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939463296:12345-0@lo:400: Request processed in 64us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868588.842187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787868588.842200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787868588.842221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939462656:12345-0@lo:400: 00000100:00100000:0.0:1787868588.842252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939462656:12345-0@lo:400: Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868588.842258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787868588.842270:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868588.842275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939463168:12345-0@lo:400: 00000100:00100000:0.0:1787868588.842299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939463168:12345-0@lo:400: Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868588.842305:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787868588.842336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f95e00 x1874715939462656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868588.842347:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939462656:0@lo:400: 00010000:00080000:0.0:1787868588.842360:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97840 x1874715939463168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868588.842369:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939463168:0@lo:400: 00010000:00080000:0.0:1787868588.842381:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97480 x1874715939463296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868588.842388:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939463296:0@lo:400: 00000100:00080000:3.0:1787868588.842556:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868588.842560:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868588.842784:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939462784 00000100:00100000:2.0:1787868588.842789:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939462784 00000100:00100000:2.0:1787868588.842902:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787868588.842912:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939462784:12345-0@lo:400: 00000100:00100000:2.0:1787868588.842966:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939462784:12345-0@lo:400: Request processed in 56us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868588.842972:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868588.843041:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939462784:0@lo:400: 00010000:00010000:2.0:1787868589.154388:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787868589.258707:0:8848:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868589.259033:0:8848:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787868590.177575:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868591.201583:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787868591.907531:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787868591.908610:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daaf704800 from 30 10000000:01000000:1.0:1787868591.908619:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787868591.908676:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868591.908688:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868591.908698:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868591.908722:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463424:0@lo:101: 00000100:00100000:1.0:1787868591.908800:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868591.908855:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.908986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463424 00000100:00100000:2.0:1787868591.909000:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463424 00000100:00100000:2.0:1787868591.909092:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787868591.909102:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:6510:x1874715939463424:12345-0@lo:101: 00010000:00010000:2.0:1787868591.909116:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868591.909129:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce16 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.909152:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.909326:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.909335:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d3800, rc 0) 00000100:00100000:2.0:1787868591.909420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939463424:12345-0@lo:101: Request processed in 320us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.909427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787868591.922243:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463424:0@lo:101: 00010000:00010000:3.0:1787868591.922291:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.922304:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868591.922392:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463552:0@lo:501: 00000100:00100000:3.0:1787868591.922453:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.922496:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.922517:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463552 00000100:00100000:3.0:1787868591.922523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463552 00000100:00100000:3.0:1787868591.922563:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787868591.922571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939463552:12345-0@lo:501: 00000100:00100000:3.0:1787868591.922702:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939463552:12345-0@lo:501: Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.922710:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787868591.922747:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463552:0@lo:501: 00000100:00100000:3.0:1787868591.922773:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463680:0@lo:503: 00000100:00100000:3.0:1787868591.922808:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.922823:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.922835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463680 00000100:00100000:3.0:1787868591.922838:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463680 00000100:00100000:3.0:1787868591.922858:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868591.922864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939463680:12345-0@lo:503: 00000100:00100000:3.0:1787868591.922931:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939463680:12345-0@lo:503: Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.922938:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868591.922978:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939463680:0@lo:503: 00000100:00100000:3.0:1787868591.923147:0:8943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8943:1874715939463808:0@lo:502: 00000100:00100000:3.0:1787868591.923199:0:8943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.923217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463808 00000100:00100000:3.0:1787868591.923221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463808 00000100:00100000:3.0:1787868591.923242:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787868591.923248:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8943:x1874715939463808:12345-0@lo:502: 00000100:00100000:3.0:1787868591.923312:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8943:x1874715939463808:12345-0@lo:502: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.923319:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787868591.923351:0:8943:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.923362:0:8943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8943:1874715939463808:0@lo:502: 00000100:00100000:3.0:1787868591.923397:0:8943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8943:1874715939463936:0@lo:502: 00000100:00100000:3.0:1787868591.923426:0:8943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.923442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939463936 00000100:00100000:3.0:1787868591.923445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939463936 00000100:00100000:3.0:1787868591.923463:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868591.923469:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8943:x1874715939463936:12345-0@lo:502: 00000100:00100000:3.0:1787868591.923521:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:8943:x1874715939463936:12345-0@lo:502: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.923528:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868591.923553:0:8943:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.923563:0:8943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8943:1874715939463936:0@lo:502: 00000040:00080000:3.0:1787868591.923579:0:8943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787868591.923627:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787868591.923642:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787868591.923655:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923663:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868591.923683:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787868591.923686:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daaf704800 from 5 10000000:01000000:3.0:1787868591.923689:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787868591.923713:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923720:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923730:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868591.923741:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464064:0@lo:101: 00000100:00100000:3.0:1787868591.923764:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.923776:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.923785:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464064 00000100:00100000:3.0:1787868591.923789:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464064 00000100:00100000:3.0:1787868591.923809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868591.923815:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939464064:12345-0@lo:101: 00010000:00010000:3.0:1787868591.923822:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868591.923832:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce24 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923850:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923866:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923874:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20ffc00, rc 0) 00000100:00100000:3.0:1787868591.923900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939464064:12345-0@lo:101: Request processed in 86us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.923906:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868591.923933:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464064:0@lo:101: 00010000:00010000:3.0:1787868591.923943:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.923951:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868591.923991:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464192:0@lo:256: 00000100:00100000:3.0:1787868591.924020:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.924031:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.924041:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464192 00000100:00100000:3.0:1787868591.924044:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464192 00000100:00100000:3.0:1787868591.924061:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787868591.924066:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939464192:12345-0@lo:256: 20000000:01000000:3.0:1787868591.924078:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787868591.924092:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787868591.924095:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787868591.924171:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939464192:12345-0@lo:256: Request processed in 103us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.924178:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787868591.924210:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464192:0@lo:256: 10000000:01000000:3.0:1787868591.924252:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868591.924257:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924265:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868591.924271:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787868591.924273:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787868591.924275:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787868591.924288:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924294:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924300:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868591.924309:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464320:0@lo:101: 00000100:00100000:3.0:1787868591.924330:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.924341:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.924350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464320 00000100:00100000:3.0:1787868591.924353:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464320 00000100:00100000:3.0:1787868591.924370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787868591.924376:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939464320:12345-0@lo:101: 00010000:00010000:3.0:1787868591.924382:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868591.924389:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce32 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924407:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924415:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868591.924421:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20ffe00, rc 0) 00000100:00100000:3.0:1787868591.924451:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939464320:12345-0@lo:101: Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.924457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787868591.924462:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464320:0@lo:101: 00010000:00010000:1.0:1787868591.924473:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868591.924481:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868591.924529:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464448:0@lo:501: 00000100:00100000:1.0:1787868591.924556:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868591.924575:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.933242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464448 00000100:00100000:3.0:1787868591.933260:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464448 00000100:00100000:3.0:1787868591.933329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787868591.933339:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939464448:12345-0@lo:501: 00000100:00100000:3.0:1787868591.933531:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939464448:12345-0@lo:501: Request processed in 193us (8973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.933539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787868591.933640:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464448:0@lo:501: 00000100:00100000:1.0:1787868591.933704:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464576:0@lo:503: 00000100:00100000:1.0:1787868591.933761:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868591.933899:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.936340:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464576 00000100:00100000:3.0:1787868591.936353:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464576 00000100:00100000:3.0:1787868591.936411:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787868591.936421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939464576:12345-0@lo:503: 00000100:00100000:3.0:1787868591.936586:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939464576:12345-0@lo:503: Request processed in 166us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.936594:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787868591.936695:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939464576:0@lo:503: 00000100:00100000:3.0:1787868591.938317:0:8945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8945:1874715939464704:0@lo:502: 00000100:00100000:3.0:1787868591.938385:0:8945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.938435:0:8945:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.938482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464704 00000100:00100000:2.0:1787868591.938488:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464704 00000100:00100000:2.0:1787868591.938531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787868591.938540:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8945:x1874715939464704:12345-0@lo:502: 00000100:00100000:2.0:1787868591.938652:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8945:x1874715939464704:12345-0@lo:502: Request processed in 113us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.938660:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787868591.939305:0:8945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8945:1874715939464704:0@lo:502: 00000020:01000000:3.0:1787868591.939335:0:8945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787868591.939343:0:8945:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787868591.939350:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868591.939352:0:8945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787868591.939360:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787868591.939364:0:8945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1787868591.939386:0:8945:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787868591.939388:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868591.939411:0:8945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93dabd848000) 00000020:00000080:3.0:1787868591.939433:0:8945:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787868591.939440:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787868591.939514:0:8945:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787868591.939520:0:8945:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787868591.939527:0:8945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2ce47 00010000:00080000:3.0:1787868591.939554:0:8945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab6dbd000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868591.939809:0:8945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787868591.968052:0:8945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787868591.968080:0:8945:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787868591.968343:0:8945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868591.968560:0:8945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868591.968651:0:8945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787868591.968750:0:8945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787868591.975591:0:8952:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868591.975601:0:8952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787868591.976372:0:8945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868591.976385:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787868591.976423:0:8945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787868591.976446:0:8945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ce4e 00000100:00080000:0.0:1787868591.976461:0:8945:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787868591.976468:0:8945:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab6dbd000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868591.976504:0:8945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da930930c0 x1874715939464832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787868591.976525:0:8945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787868591.976593:0:8945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868591.976597:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868591.976599:0:8945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787868591.976602:0:8945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868591.976606:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868591.976607:0:8945:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787868591.976610:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868591.976611:0:8945:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787868591.976639:0:8945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8945:1874715939464960:0@lo:502: 00000100:00100000:0.0:1787868591.976729:0:8945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868591.976783:0:8945:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787868591.976853:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939464832:0@lo:8: 00000100:00100000:1.0:1787868591.976891:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868591.977210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464960 00000100:00100000:1.0:1787868591.977218:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464960 00000100:00100000:1.0:1787868591.977262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787868591.977270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8945:x1874715939464960:12345-0@lo:502: 00000100:00100000:1.0:1787868591.977392:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:8945:x1874715939464960:12345-0@lo:502: Request processed in 121us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868591.977399:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787868591.977546:0:8945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8945:1874715939464960:0@lo:502: 00000020:01000000:1.0:1787868591.977574:0:8945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868591.977584:0:8945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868591.977586:0:8945:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787868591.977591:0:8945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1787868591.978130:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939465088:0@lo:400: 00000100:00100000:3.0:1787868591.978196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978225:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939465600:0@lo:400: 00000100:00100000:3.0:1787868591.978247:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978268:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787868591.978274:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939465216:0@lo:400: 00000100:00100000:3.0:1787868591.978308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978326:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939465728:0@lo:400: 00000100:00100000:3.0:1787868591.978344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978372:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939465344:0@lo:400: 00000100:00100000:3.0:1787868591.978394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978406:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868591.978411:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939465472:0@lo:400: 00000100:00100000:3.0:1787868591.978447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868591.978480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465088 00000100:00100000:3.0:1787868591.978485:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465088 00000100:00100000:3.0:1787868591.978512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465600 00000100:00100000:3.0:1787868591.978515:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465600 00000100:00100000:3.0:1787868591.978538:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465728 00000100:00100000:3.0:1787868591.978540:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465728 00000100:00100000:3.0:1787868591.978551:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465344 00000100:00100000:3.0:1787868591.978553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465344 00000100:00100000:3.0:1787868591.978565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787868591.978570:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939465088:12345-0@lo:400: 00000100:00100000:3.0:1787868591.978612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939465088:12345-0@lo:400: Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.978617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787868591.978629:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868591.978635:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939465600:12345-0@lo:400: 00000100:00100000:3.0:1787868591.978660:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939465600:12345-0@lo:400: Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.978676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868591.978688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868591.978693:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939465728:12345-0@lo:400: 00000100:00100000:3.0:1787868591.978729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939465728:12345-0@lo:400: Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.978735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868591.978777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868591.978784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939465344:12345-0@lo:400: 00000100:00100000:3.0:1787868591.978814:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939465344:12345-0@lo:400: Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.978819:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868591.978835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465216 00000100:00100000:3.0:1787868591.978838:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465216 00000100:00100000:3.0:1787868591.978859:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465472 00000100:00100000:3.0:1787868591.978862:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465472 00000100:00100000:3.0:1787868591.978875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868591.978881:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939465216:12345-0@lo:400: 00000100:00100000:3.0:1787868591.978911:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939465216:12345-0@lo:400: Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.978916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868591.978927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868591.978932:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939465472:12345-0@lo:400: 00000100:00100000:0.0:1787868591.979013:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939464832 00000100:00100000:0.0:1787868591.979018:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939464832 00000100:00100000:0.0:1787868591.979041:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868591.979045:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939464832:12345-0@lo:8: 00010000:00080000:0.0:1787868591.979067:0:8429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1787868591.979094:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ce55 00002000:00100000:0.0:1787868591.979132:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93d986fa5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787868591.979136:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787868591.979139:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787868591.979214:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787868591.979538:0:8429:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787868591.979564:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868591.979621:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939464832:12345-0@lo:8: Request processed in 574us (2728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868591.979627:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787868591.979683:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da930930c0 x1874715939464832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868591.979696:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868591.979704:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787868591.979712:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787868591.979717:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787868591.979720:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6dbd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787868591.979732:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787868591.979736:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939464832:0@lo:8: 00000004:00080000:0.0:1787868591.979760:0:8952:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787868591.979812:0:8952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 216105655327ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787868591.979818:0:8952:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:2.0:1787868591.980225:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787868591.980258:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787868591.980269:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980287:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868591.980297:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787868591.980299:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05d8800 from 30 10000000:01000000:2.0:1787868591.980302:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787868591.980330:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980337:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980345:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868591.980360:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939465856:0@lo:101: 00000100:00100000:2.0:1787868591.980400:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.980431:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.980447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465856 00000100:00100000:2.0:1787868591.980451:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465856 00000100:00100000:2.0:1787868591.980482:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787868591.980489:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939465856:12345-0@lo:101: 00010000:00010000:2.0:1787868591.980497:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868591.980509:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce5c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980530:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980550:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980558:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d3000, rc 0) 00000100:00100000:2.0:1787868591.980588:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939465856:12345-0@lo:101: Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.980593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787868591.980624:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939465856:0@lo:101: 00010000:00010000:2.0:1787868591.980636:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.980644:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868591.980700:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939465984:0@lo:501: 00000100:00100000:2.0:1787868591.980721:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.980734:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.980745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939465984 00000100:00100000:2.0:1787868591.980748:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939465984 00000100:00100000:2.0:1787868591.980779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787868591.980785:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939465984:12345-0@lo:501: 00000100:00100000:2.0:1787868591.980883:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939465984:12345-0@lo:501: Request processed in 98us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.980890:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787868591.980921:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939465984:0@lo:501: 00000100:00100000:2.0:1787868591.980945:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466112:0@lo:503: 00000100:00100000:2.0:1787868591.980986:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.980998:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.981009:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466112 00000100:00100000:2.0:1787868591.981012:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466112 00000100:00100000:2.0:1787868591.981032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787868591.981037:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939466112:12345-0@lo:503: 00000100:00100000:2.0:1787868591.981109:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939466112:12345-0@lo:503: Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.981115:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787868591.981175:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466112:0@lo:503: 00000100:00100000:1.0:1787868591.982303:0:8953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939466240:0@lo:700: 00000100:00100000:1.0:1787868591.982386:0:8953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868591.982412:0:8953:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868591.982498:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466240 00000100:00100000:0.0:1787868591.982504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466240 00000100:00100000:0.0:1787868591.982554:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868591.982562:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8953:x1874715939466240:12345-0@lo:700: 00000100:00100000:0.0:1787868591.982592:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8437:1874715939466368:0@lo:700: 00000100:00100000:0.0:1787868591.982622:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868591.982639:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868591.982655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466368 00000100:00100000:0.0:1787868591.982658:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466368 00000100:00100000:0.0:1787868591.982701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868591.982707:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8437:x1874715939466368:12345-0@lo:700: 00000100:00100000:1.0:1787868591.984262:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939465216:0@lo:400: 00010000:00080000:1.0:1787868591.984282:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8f840 x1874715939465728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868591.984295:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939465728:0@lo:400: 00010000:00080000:1.0:1787868591.984308:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9336bc00 x1874715939465088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868591.984316:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939465088:0@lo:400: 00010000:00080000:1.0:1787868591.984326:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da932b1680 x1874715939465600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868591.984334:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939465600:0@lo:400: 00000100:00080000:1.0:1787868591.984372:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868591.984377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868591.984380:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1787868591.986697:0:8951:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868591.986908:0:8951:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787868591.987211:0:8954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8954:1874715939466496:0@lo:502: 00000100:00100000:2.0:1787868591.987306:0:8954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.987352:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466496 00000100:00100000:2.0:1787868591.987358:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466496 00000100:00100000:2.0:1787868591.987397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787868591.987406:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8954:x1874715939466496:12345-0@lo:502: 00000100:00100000:2.0:1787868591.987521:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8954:x1874715939466496:12345-0@lo:502: Request processed in 115us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.987529:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787868591.987583:0:8954:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.987604:0:8954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8954:1874715939466496:0@lo:502: 00000100:00100000:2.0:1787868591.987647:0:8954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8954:1874715939466624:0@lo:502: 00000100:00100000:2.0:1787868591.987692:0:8954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.987713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466624 00000100:00100000:2.0:1787868591.987716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466624 00000100:00100000:2.0:1787868591.987737:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787868591.987750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8954:x1874715939466624:12345-0@lo:502: 00000100:00100000:2.0:1787868591.987808:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:8954:x1874715939466624:12345-0@lo:502: Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.987814:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787868591.987841:0:8954:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.987852:0:8954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8954:1874715939466624:0@lo:502: 00000040:00080000:2.0:1787868591.987870:0:8954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787868591.987930:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787868591.987953:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787868591.987964:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.987975:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868591.987985:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787868591.987987:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05d8800 from 5 10000000:01000000:2.0:1787868591.987990:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868591.988014:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988023:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988032:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868591.988044:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466752:0@lo:101: 00000100:00100000:2.0:1787868591.988071:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.988093:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868591.988105:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466752 00000100:00100000:2.0:1787868591.988108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466752 00000100:00100000:2.0:1787868591.988130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787868591.988137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939466752:12345-0@lo:101: 00010000:00010000:2.0:1787868591.988146:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868591.988181:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce6a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988202:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988212:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988221:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d2600, rc 0) 00000100:00100000:2.0:1787868591.988252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939466752:12345-0@lo:101: Request processed in 115us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868591.988258:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787868591.988288:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466752:0@lo:101: 00010000:00010000:2.0:1787868591.988299:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868591.988308:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868591.988348:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466880:0@lo:256: 00000100:00100000:3.0:1787868591.990934:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939465472:12345-0@lo:400: Request processed in 11992us (12477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.990950:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787868591.991721:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939465472:0@lo:400: 00010000:00080000:0.0:1787868591.991759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93369e00 x1874715939465344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868591.991780:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939465344:0@lo:400: 00000100:00100000:2.0:1787868591.998704:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868591.998767:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868591.998846:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939466880 00000100:00100000:3.0:1787868591.998855:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939466880 00000100:00100000:3.0:1787868591.998907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787868591.998917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939466880:12345-0@lo:256: 20000000:01000000:3.0:1787868591.998968:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787868591.998987:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787868591.998990:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787868591.999095:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939466880:12345-0@lo:256: Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868591.999103:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787868591.999542:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939466880:0@lo:256: 10000000:01000000:0.0:1787868591.999602:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787868591.999614:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868591.999625:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868591.999635:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787868591.999638:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787868591.999640:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787868591.999685:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868591.999693:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868591.999702:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868591.999720:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467008:0@lo:101: 00000100:00100000:0.0:1787868591.999767:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868591.999797:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2600 going to sleep for 11 seconds 00000004:00080000:3.0:1787868592.000206:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787868592.000510:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467008 00000100:00100000:2.0:1787868592.000517:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467008 00000100:00100000:2.0:1787868592.000568:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787868592.000576:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939467008:12345-0@lo:101: 00010000:00010000:2.0:1787868592.000589:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868592.000602:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ce78 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.000626:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.000637:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.000647:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d2000, rc 0) 00000100:00100000:2.0:1787868592.000711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939467008:12345-0@lo:101: Request processed in 135us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.000717:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787868592.000759:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467008:0@lo:101: 00010000:00010000:2.0:1787868592.000784:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.000793:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868592.000856:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467136:0@lo:501: 00000100:00100000:2.0:1787868592.000883:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868592.000906:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868592.000920:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467136 00000100:00100000:2.0:1787868592.000937:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467136 40000000:02000000:0.0:1787868592.002105:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787868592.003097:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787868592.003110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939467136:12345-0@lo:501: 00000100:00100000:2.0:1787868592.004086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939467136:12345-0@lo:501: Request processed in 976us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.004096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787868592.004148:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467136:0@lo:501: 00000100:00100000:2.0:1787868592.004211:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467264:0@lo:503: 00000100:00100000:2.0:1787868592.004422:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868592.004773:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868592.014847:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8437:x1874715939466368:12345-0@lo:700: Request processed in 32129us (32213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868592.014877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787868592.015223:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da930930c0 x1874715939466368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787868607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868592.015248:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8437:1874715939466368:0@lo:700: 40000000:02000000:2.0:1787868592.015262:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1787868592.016963:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467264 00000100:00100000:3.0:1787868592.016976:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467264 00000100:00100000:3.0:1787868592.017144:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868592.017178:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939467264:12345-0@lo:503: 00000100:00100000:3.0:1787868592.017351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939467264:12345-0@lo:503: Request processed in 198us (12928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868592.017359:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787868592.037233:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939467264:0@lo:503: 00000100:00100000:2.0:1787868592.037466:0:8956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8956:1874715939467392:0@lo:502: 00000100:00100000:2.0:1787868592.037540:0:8956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868592.037587:0:8956:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868592.038325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467392 00000100:00100000:3.0:1787868592.038337:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467392 00000100:00100000:3.0:1787868592.038409:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787868592.038418:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:8956:x1874715939467392:12345-0@lo:502: 00000100:00100000:3.0:1787868592.038548:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:8956:x1874715939467392:12345-0@lo:502: Request processed in 131us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868592.038556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787868592.040322:0:8956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8956:1874715939467392:0@lo:502: 00000020:01000000:2.0:1787868592.042307:0:8956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787868592.042321:0:8956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787868592.042328:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868592.042331:0:8956:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787868592.042337:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787868592.042341:0:8956:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:2.0:1787868592.042383:0:8956:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787868592.042386:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868592.042402:0:8956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93dab59f0000) 00000020:00000080:2.0:1787868592.042424:0:8956:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787868592.042430:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787868592.042578:0:8956:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787868592.042585:0:8956:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787868592.042592:0:8956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2ce8d 00010000:00080000:2.0:1787868592.043752:0:8956:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dabd86e800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787868592.044245:0:8956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1787868592.044778:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787868592.045767:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939466240:12345-0@lo:700: Request processed in 63199us (63374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868592.045785:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787868592.045942:0:8953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8f480 x1874715939466240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787868607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.046034:0:8953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939466240:0@lo:700: 00000040:01000000:3.0:1787868592.061199:0:8956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787868592.061363:0:8956:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787868592.062218:0:8956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868592.064691:0:8956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868592.066500:0:8956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787868592.066632:0:8956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787868592.074693:0:8958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868592.074702:0:8958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787868592.080506:0:8956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787868592.080523:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787868592.080571:0:8956:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787868592.080597:0:8956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2ce94 00000100:00080000:2.0:1787868592.080608:0:8956:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868592.080614:0:8956:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93dabd86e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868592.080652:0:8956:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f961c0 x1874715939467520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868592.080694:0:8956:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787868592.080767:0:8956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868592.080771:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868592.080773:0:8956:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787868592.080776:0:8956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868592.080780:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868592.080781:0:8956:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787868592.080785:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787868592.080786:0:8956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787868592.080815:0:8956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8956:1874715939467648:0@lo:502: 00000100:00100000:2.0:1787868592.080900:0:8956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868592.081102:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939467520:0@lo:8: 00000100:00100000:0.0:1787868592.081148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.082503:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939467776:0@lo:13: 00000100:00100000:1.0:1787868592.082573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787868592.082624:0:8953:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787868592.082647:0:8953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939467904:0@lo:7: 00000100:00100000:1.0:1787868592.082686:0:8953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.082714:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467520 00000100:00100000:1.0:1787868592.082721:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467520 00000100:00100000:1.0:1787868592.082750:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467904 00000100:00100000:1.0:1787868592.082754:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467904 00000100:00100000:2.0:1787868592.084081:0:8956:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868592.084111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467648 00000100:00100000:2.0:1787868592.084117:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467648 00000100:00100000:2.0:1787868592.084187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787868592.084197:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:8956:x1874715939467648:12345-0@lo:502: 00000100:00100000:2.0:1787868592.085471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:8956:x1874715939467648:12345-0@lo:502: Request processed in 1269us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.085483:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787868592.085550:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939467776 00000100:00100000:2.0:1787868592.085557:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939467776 00000100:00100000:2.0:1787868592.085597:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868592.085604:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939467776:12345-0@lo:13: 00002000:00000024:2.0:1787868592.086180:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787868592.086315:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939467776:12345-0@lo:13: Request processed in 709us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.086321:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868592.086381:0:8956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:8956:1874715939467648:0@lo:502: 00000020:01000000:2.0:1787868592.086417:0:8956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868592.086425:0:8956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868592.086427:0:8956:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787868592.086432:0:8956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787868592.086552:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787868592.086576:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787868592.086586:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.086596:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868592.086616:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787868592.086619:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93daae688000 from 1 10000000:01000000:2.0:1787868592.086621:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1787868592.087088:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868592.087097:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3635:x1874715939467520:12345-0@lo:8: 00010000:00080000:3.0:1787868592.087125:0:8431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1787868592.087182:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2ce9b 00002000:00100000:3.0:1787868592.087198:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93dab6dbc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787868592.087203:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787868592.087212:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:2.0:1787868592.087212:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.087223:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.087231:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787868592.087477:0:8431:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787868592.087509:0:8431:0:(import.c:65:import_set_state_nolock()) ffff93dab6dba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868592.087589:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939467520:12345-0@lo:8: Request processed in 491us (6442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868592.087596:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787868592.087609:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f961c0 x1874715939467520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868592.087622:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868592.087644:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787868592.087653:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787868592.087660:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787868592.087674:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabd86e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787868592.087686:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787868592.087691:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939467520:0@lo:8: 00000004:00080000:0.0:1787868592.087721:0:8958:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787868592.087792:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939468032:0@lo:101: 00000100:00100000:2.0:1787868592.087835:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.087863:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868592.087868:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787868592.087875:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939467904:12345-0@lo:7: 00000100:00100000:2.0:1787868592.087887:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468032 00000100:00100000:2.0:1787868592.087894:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468032 00000100:00100000:2.0:1787868592.087926:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787868592.087933:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939468032:12345-0@lo:101: 00010000:00010000:2.0:1787868592.088176:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868592.088210:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cea2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.088314:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.088325:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.088347:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868592.088382:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939468032:12345-0@lo:101: Request processed in 449us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.088388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787868592.088428:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939468032:0@lo:101: 00010000:00010000:2.0:1787868592.088441:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868592.088450:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868592.088506:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939468160:0@lo:501: 00000100:00100000:2.0:1787868592.088529:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868592.088549:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868592.088560:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468160 00000100:00100000:2.0:1787868592.088563:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468160 00000100:00100000:2.0:1787868592.088584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787868592.088590:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939468160:12345-0@lo:501: 00000004:00080000:0.0:1787868592.088734:0:8958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 216214577493ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787868592.088741:0:8958:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787868592.089054:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939468160:12345-0@lo:501: Request processed in 463us (523us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787868592.089062:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787868592.089074:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939468160:0@lo:501: 10000000:01000000:3.0:1787868592.089109:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787868592.089116:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868592.089125:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868592.090106:0:8953:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00010000:00080000:0.0:1787868592.090212:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8f480 x1874715939467776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868592.090231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939467776:0@lo:13: 00002000:00080000:0.0:1787868592.101553:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787868592.101564:0:8429:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787868592.101686:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939467904:12345-0@lo:7: Request processed in 13810us (18995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868592.101698:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787868592.102271:0:8953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8e1c0 x1874715939467904/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.102289:0:8953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939467904:0@lo:7: 00000004:00080000:1.0:1787868592.102304:0:8953:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787868592.102347:0:8953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939468288:0@lo:5: 00000100:00100000:1.0:1787868592.102388:0:8953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.102430:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468288 00000100:00100000:1.0:1787868592.102437:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468288 00000100:00100000:1.0:1787868592.102487:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868592.102497:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939468288:12345-0@lo:5: 00002000:00080000:1.0:1787868592.102532:0:8431:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787868592.102587:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939468288:12345-0@lo:5: Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868592.102594:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868592.102623:0:8953:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00010000:00080000:1.0:1787868592.102637:0:8953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8e1c0 x1874715939468288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.102659:0:8953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939468288:0@lo:5: 00000004:00080000:1.0:1787868592.102681:0:8953:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787868592.102706:0:8953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939468416:0@lo:5: 00000100:00100000:1.0:1787868592.102730:0:8953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.102744:0:8953:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868592.103036:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468416 00000100:00100000:0.0:1787868592.103041:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468416 00000100:00100000:0.0:1787868592.103069:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787868592.103077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8953:x1874715939468416:12345-0@lo:5: 00002000:00080000:0.0:1787868592.103101:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:3.0:1787868592.104376:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787868592.104473:0:8960:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787868592.104498:0:8960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939468672:0@lo:7: 00000100:00100000:3.0:1787868592.104566:0:8960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868592.104587:0:8960:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03000 going to sleep for 11 seconds 00000100:00100000:3.0:1787868592.105889:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868592.105906:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787868592.105922:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868592.105930:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468672 00000100:00100000:3.0:1787868592.105938:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468672 00000100:00100000:1.0:1787868592.106102:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939468544:0@lo:13: 00000100:00100000:1.0:1787868592.106179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868592.106204:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468544 00000100:00100000:3.0:1787868592.106210:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468544 00000100:00100000:3.0:1787868592.106252:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868592.106262:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874715939468544:12345-0@lo:13: 00002000:00000024:3.0:1787868592.106282:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:3.0:1787868592.106335:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874715939468544:12345-0@lo:13: Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00080000:1.0:1787868592.106341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868592.106344:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787868592.106375:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9863c3480 x1874715939468544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.106396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939468544:0@lo:13: 00000100:00100000:0.0:1787868592.107583:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8953:x1874715939468416:12345-0@lo:5: Request processed in 4502us (4847us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787868592.107593:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787868592.107619:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868592.107630:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8960:x1874715939468672:12345-0@lo:7: 00010000:00080000:1.0:1787868592.109004:0:8953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8e1c0 x1874715939468416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.109027:0:8953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8953:1874715939468416:0@lo:5: 00000004:00080000:1.0:1787868592.109046:0:8953:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787868592.109095:0:8953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8953:1874715939468800:0@lo:900: 00000100:00100000:1.0:1787868592.109152:0:8953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.109410:0:8953:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868592.109517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468800 00000100:00100000:2.0:1787868592.109525:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468800 00000100:00100000:2.0:1787868592.109579:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868592.109589:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8953:x1874715939468800:12345-0@lo:900: 00000100:00100000:2.0:1787868592.109673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8953:x1874715939468800:12345-0@lo:900: Request processed in 76us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868592.109687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787868592.109721:0:8953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8fc00 x1874715939468800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868592.109732:0:8953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8953:1874715939468800:0@lo:900: 00002000:00080000:0.0:1787868592.140874:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787868592.140887:0:8430:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787868592.141019:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8960:x1874715939468672:12345-0@lo:7: Request processed in 33386us (36447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868592.141032:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787868592.141074:0:8960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9863c0b40 x1874715939468672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868592.141091:0:8960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939468672:0@lo:7: 00000004:00080000:3.0:1787868592.141109:0:8960:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787868592.141256:0:8960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939468928:0@lo:5: 00000100:00100000:3.0:1787868592.141294:0:8960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868592.141340:0:8960:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868592.142362:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939468928 00000100:00100000:0.0:1787868592.142374:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939468928 00000100:00100000:0.0:1787868592.143004:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787868592.143018:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8960:x1874715939468928:12345-0@lo:5: 00002000:00080000:0.0:1787868592.143061:0:8429:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787868592.143066:0:8429:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787868592.170916:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787868592.170933:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787868592.170939:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787868592.171059:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8960:x1874715939468928:12345-0@lo:5: Request processed in 28041us (29760us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787868592.171070:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787868592.171124:0:8960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9863c0b40 x1874715939468928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868592.171142:0:8960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787868592.171149:0:8960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939468928:0@lo:5: 00000004:00080000:0.0:1787868592.171186:0:8960:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787868592.171234:0:8960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939469056:0@lo:700: 00000100:00100000:0.0:1787868592.171271:0:8960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868592.171305:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469056 00000100:00100000:0.0:1787868592.171310:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469056 00000100:00100000:0.0:1787868592.171347:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868592.171354:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8960:x1874715939469056:12345-0@lo:700: 00000100:00100000:0.0:1787868592.171490:0:8960:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868592.207550:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8960:x1874715939469056:12345-0@lo:700: Request processed in 36187us (36269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868592.207567:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787868592.209772:0:8960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9393d2c0 x1874715939469056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868592.209794:0:8960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939469056:0@lo:700: 00000004:02000040:0.0:1787868592.215062:0:8960:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00010000:00010000:0.0:1787868592.229984:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868592.231927:0:8960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939469184:0@lo:5: 00000100:00100000:0.0:1787868592.232014:0:8960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868592.232072:0:8960:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787868592.232179:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469184 00000100:00100000:1.0:1787868592.232187:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469184 00000100:00100000:1.0:1787868592.232248:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868592.232258:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8960:x1874715939469184:12345-0@lo:5: 00002000:00080000:1.0:1787868592.246244:0:8962:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787868592.246267:0:8962:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1787868592.256502:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8960:x1874715939469184:12345-0@lo:5: Request processed in 24236us (24478us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787868592.256519:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787868592.256819:0:8960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9393d2c0 x1874715939469184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868592.256839:0:8960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8960:1874715939469184:0@lo:5: 00000004:00080000:0.0:1787868592.256855:0:8960:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1787868592.418591:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868592.418957:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939469312:0@lo:41: 00000100:00100000:3.0:1787868592.419032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868592.419329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469312 00000100:00100000:1.0:1787868592.419340:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469312 00000100:00100000:1.0:1787868592.419427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868592.419438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939469312:12345-0@lo:41: 00000004:00000024:1.0:1787868592.419471:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787868592.419534:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939469312:12345-0@lo:41: Request processed in 97us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868592.419541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868592.419619:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939469312:0@lo:41: 00000100:00100000:1.0:1787868592.929334:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939469440:0@lo:41: 00000100:00100000:1.0:1787868592.929402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868592.929574:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469440 00000100:00100000:0.0:1787868592.929581:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469440 00000100:00100000:0.0:1787868592.929632:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787868592.930404:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939469440:12345-0@lo:41: 00000004:00000024:0.0:1787868592.930438:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787868592.930531:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939469440:12345-0@lo:41: Request processed in 890us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868592.930539:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868592.930637:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939469440:0@lo:41: 00000020:00000004:2.0:1787868593.065265:0:9006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868593.065277:0:9006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787868593.249607:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868594.274297:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868595.297288:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868596.321989:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868597.345334:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868597.537973:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868597.538000:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939469568:0@lo:13: 00000100:00100000:0.0:1787868597.538074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868597.538211:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469568 00000100:00100000:2.0:1787868597.538227:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469568 00000100:00100000:2.0:1787868597.538286:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868597.538296:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939469568:12345-0@lo:13: 00002000:00000024:2.0:1787868597.538324:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868597.538374:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939469568:12345-0@lo:13: Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868597.538381:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787868597.538402:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787868597.538435:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f943c0 x1874715939469568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868597.538445:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787868597.538464:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939469568:0@lo:13: 00000100:00100000:2.0:1787868597.538855:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939469696:0@lo:41: 00000100:00100000:2.0:1787868597.538900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868597.539025:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469696 00000100:00100000:0.0:1787868597.539030:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469696 00000100:00100000:0.0:1787868597.539068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787868597.539076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939469696:12345-0@lo:41: 00000004:00000024:0.0:1787868597.539101:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787868597.539138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939469696:12345-0@lo:41: Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868597.539144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787868597.539495:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939469696:0@lo:41: 00000100:00100000:2.0:1787868597.540210:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939470208:0@lo:400: 00000100:00100000:2.0:1787868597.540272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868597.540297:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787868597.540305:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939470080:0@lo:400: 00000100:00100000:2.0:1787868597.540329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868597.540345:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939470592:0@lo:400: 00000100:00100000:2.0:1787868597.540371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.541411:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939469824:0@lo:400: 00000100:00100000:3.0:1787868597.541459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.541494:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939470336:0@lo:400: 00000100:00100000:3.0:1787868597.541527:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.541549:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787868597.541626:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939469952:0@lo:400: 00000100:00100000:3.0:1787868597.541654:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.541881:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939470464:0@lo:400: 00000100:00100000:3.0:1787868597.541911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.541940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470080 00000100:00100000:3.0:1787868597.541948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470080 00000100:00100000:3.0:1787868597.541986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470336 00000100:00100000:3.0:1787868597.541989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470336 00000100:00100000:3.0:1787868597.542012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469952 00000100:00100000:3.0:1787868597.542015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469952 00000100:00100000:3.0:1787868597.542025:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470464 00000100:00100000:3.0:1787868597.542027:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470464 00000100:00100000:3.0:1787868597.542042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868597.542050:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939470080:12345-0@lo:400: 00000100:00100000:3.0:1787868597.542106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939470080:12345-0@lo:400: Request processed in 56us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.542113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868597.542129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787868597.542135:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939470336:12345-0@lo:400: 00000100:00100000:3.0:1787868597.542193:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939470336:12345-0@lo:400: Request processed in 58us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.542212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787868597.542232:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787868597.542238:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939469952:12345-0@lo:400: 00000100:00100000:3.0:1787868597.542269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939469952:12345-0@lo:400: Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.542282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787868597.542295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787868597.542302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939470464:12345-0@lo:400: 00000100:00100000:3.0:1787868597.542330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939470464:12345-0@lo:400: Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.542335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787868597.542358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868597.542361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787868597.542386:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f95680 x1874715939469952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.542400:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939469952:0@lo:400: 00010000:00080000:3.0:1787868597.542411:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97840 x1874715939470464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.542419:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939470464:0@lo:400: 00010000:00080000:3.0:1787868597.542428:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97480 x1874715939470336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.542436:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939470336:0@lo:400: 00010000:00080000:3.0:1787868597.542471:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f952c0 x1874715939470080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.542480:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939470080:0@lo:400: 00000100:00100000:0.0:1787868597.545094:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470208 00000100:00100000:0.0:1787868597.545106:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470208 00000100:00100000:0.0:1787868597.545176:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787868597.545186:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939470208:12345-0@lo:400: 00000100:00100000:0.0:1787868597.546429:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939470208:12345-0@lo:400: Request processed in 1240us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868597.546440:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787868597.546690:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868597.546709:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939470720:0@lo:13: 00000100:00100000:3.0:1787868597.546751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868597.546807:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470720 00000100:00100000:3.0:1787868597.546813:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470720 00000100:00100000:3.0:1787868597.546853:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868597.546860:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939470720:12345-0@lo:13: 00002000:00000024:3.0:1787868597.546886:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868597.546921:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939470720:12345-0@lo:13: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.546928:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787868597.546948:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868597.546974:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6e99680 x1874715939470720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.546993:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939470720:0@lo:13: 00000100:00100000:3.0:1787868597.547026:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939470208:0@lo:400: 00000100:00100000:2.0:1787868597.547485:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939469824 00000100:00100000:2.0:1787868597.547490:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939469824 00000100:00100000:2.0:1787868597.547520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787868597.547528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3636:x1874715939469824:12345-0@lo:400: 00000100:00100000:2.0:1787868597.547967:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3636:x1874715939469824:12345-0@lo:400: Request processed in 439us (6506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868597.547975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787868597.548103:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939469824:0@lo:400: 00000100:00100000:3.0:1787868597.549388:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470592 00000100:00100000:3.0:1787868597.549396:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470592 00000100:00100000:3.0:1787868597.549446:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868597.549455:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939470592:12345-0@lo:400: 00000100:00100000:3.0:1787868597.549523:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939470592:12345-0@lo:400: Request processed in 70us (9150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868597.549531:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787868597.549583:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f95e00 x1874715939470592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868597.549598:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939470592:0@lo:400: 00000100:00100000:0.0:1787868598.050979:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868598.051070:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939470848:0@lo:41: 00000100:00100000:0.0:1787868598.051194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868598.052602:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470848 00000100:00100000:0.0:1787868598.052613:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470848 00000100:00100000:0.0:1787868598.052739:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787868598.052753:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939470848:12345-0@lo:41: 00000004:00000024:0.0:1787868598.052795:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787868598.053570:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939470848:12345-0@lo:41: Request processed in 819us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868598.053581:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787868598.053634:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939470848:0@lo:41: 00000001:00080000:1.0:1787868598.066331:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1787868598.386852:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868599.396518:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868600.431705:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868601.448765:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868602.466317:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868602.659069:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939470976:0@lo:400: 00000100:00100000:2.0:1787868602.659147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868602.659369:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939471488:0@lo:400: 00000100:00100000:2.0:1787868602.659403:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868602.659428:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472000:0@lo:400: 00000100:00100000:2.0:1787868602.659453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868602.659490:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787868602.659497:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939471360:0@lo:400: 00000100:00100000:2.0:1787868602.659524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868602.659540:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939471872:0@lo:400: 00000100:00100000:2.0:1787868602.659579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868602.659617:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939470976 00000100:00100000:2.0:1787868602.659625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939470976 00000100:00100000:2.0:1787868602.659678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787868602.659688:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3637:x1874715939470976:12345-0@lo:400: 00000100:00100000:2.0:1787868602.659742:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3637:x1874715939470976:12345-0@lo:400: Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868602.659750:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787868602.659782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471488 00000100:00100000:2.0:1787868602.659786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471488 00000100:00100000:2.0:1787868602.659812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787868602.659818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939471488:12345-0@lo:400: 00000100:00100000:2.0:1787868602.659852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939471488:12345-0@lo:400: Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868602.659858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787868602.659900:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939470976:0@lo:400: 00000100:00100000:2.0:1787868602.659913:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939471488:0@lo:400: 00000100:00100000:1.0:1787868602.660053:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472000 00000100:00100000:1.0:1787868602.660057:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472000 00000100:00100000:1.0:1787868602.660091:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471872 00000100:00100000:1.0:1787868602.660094:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471872 00000100:00100000:1.0:1787868602.660115:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868602.660122:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472000:12345-0@lo:400: 00000100:00100000:1.0:1787868602.660179:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472000:12345-0@lo:400: Request processed in 58us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868602.660186:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868602.660201:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868602.660208:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939471872:12345-0@lo:400: 00000100:00100000:1.0:1787868602.660249:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939471872:12345-0@lo:400: Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868602.660254:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868602.663589:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939471104:0@lo:400: 00000100:00100000:3.0:1787868602.663664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868602.663704:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939471616:0@lo:400: 00000100:00100000:3.0:1787868602.663748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868602.663786:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939472128:0@lo:41: 00000100:00100000:0.0:1787868602.663792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471360 00000100:00100000:0.0:1787868602.663802:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471360 00000100:00100000:3.0:1787868602.663817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868602.663845:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471104 00000100:00100000:0.0:1787868602.663848:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471104 00000100:00100000:0.0:1787868602.663860:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471616 00000100:00100000:0.0:1787868602.663862:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471616 00000100:00100000:0.0:1787868602.663882:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787868602.663891:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939471360:12345-0@lo:400: 00000100:00100000:0.0:1787868602.663956:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939471360:12345-0@lo:400: Request processed in 66us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868602.663963:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787868602.663981:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868602.663987:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939471104:12345-0@lo:400: 00000100:00100000:0.0:1787868602.664015:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939471104:12345-0@lo:400: Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868602.664020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868602.664039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868602.664045:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939471616:12345-0@lo:400: 00000100:00100000:0.0:1787868602.664082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939471616:12345-0@lo:400: Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868602.664089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787868602.664099:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f970c0 x1874715939471104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868602.664113:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939471104:0@lo:400: 00010000:00080000:3.0:1787868602.664440:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f94000 x1874715939471616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868602.664456:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939471616:0@lo:400: 00000100:00100000:3.0:1787868602.664488:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787868602.664501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939471232:0@lo:400: 00000100:00100000:3.0:1787868602.664532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868602.664557:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939471744:0@lo:400: 00000100:00100000:3.0:1787868602.664581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868602.664605:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939472256:0@lo:13: 00000100:00100000:0.0:1787868602.664607:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471744 00000100:00100000:0.0:1787868602.664613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471744 00000100:00100000:3.0:1787868602.664642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868602.664645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868602.664654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939471744:12345-0@lo:400: 00000100:00080000:3.0:1787868602.664684:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868602.664689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868602.664692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868602.664702:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939471744:12345-0@lo:400: Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868602.664709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868602.664723:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472128 00000100:00100000:3.0:1787868602.664728:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472128 00000100:00100000:3.0:1787868602.664757:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939471232 00000100:00100000:3.0:1787868602.664760:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939471232 00000100:00100000:3.0:1787868602.664772:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868602.664781:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939472128:12345-0@lo:41: 00000004:00000024:3.0:1787868602.664805:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787868602.666094:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868602.669144:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939472128:12345-0@lo:41: Request processed in 4353us (5316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868602.669520:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472384:0@lo:13: 00000100:00100000:3.0:1787868602.669685:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787868602.669704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868602.669733:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868602.669748:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939471232:12345-0@lo:400: 00010000:00080000:2.0:1787868602.669780:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f95e00 x1874715939471360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868602.669796:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939471360:0@lo:400: 00010000:00080000:2.0:1787868602.669810:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97480 x1874715939471872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868602.669818:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939471872:0@lo:400: 00010000:00080000:2.0:1787868602.669827:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97840 x1874715939472000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868602.669847:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787868602.669863:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472000:0@lo:400: 00000100:00100000:3.0:1787868602.669887:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939471232:12345-0@lo:400: Request processed in 144us (5355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868602.669896:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868602.669933:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472256 00000100:00100000:3.0:1787868602.669940:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472256 00000100:00100000:3.0:1787868602.670480:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472384 00000100:00100000:3.0:1787868602.670485:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472384 00000100:00100000:2.0:1787868602.670501:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939471232:0@lo:400: 00000100:00100000:3.0:1787868602.670508:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868602.670517:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939472256:12345-0@lo:13: 00010000:00080000:2.0:1787868602.670538:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f952c0 x1874715939471744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1787868602.670543:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868602.670587:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939472256:12345-0@lo:13: Request processed in 71us (5945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868602.670593:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868602.670607:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787868602.670613:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472384:12345-0@lo:13: 00002000:00000024:3.0:1787868602.670637:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868602.670674:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472384:12345-0@lo:13: Request processed in 61us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868602.670680:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787868602.670725:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6e99a40 x1874715939472384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868602.670740:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472384:0@lo:13: 00000100:00100000:2.0:1787868602.671651:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939471744:0@lo:400: 00010000:00080000:2.0:1787868602.671677:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6f1c000 x1874715939472256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868602.671692:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939472256:0@lo:13: 00000100:00100000:2.0:1787868602.671705:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939472128:0@lo:41: 00000100:00100000:3.0:1787868603.173490:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472512:0@lo:41: 00000100:00100000:3.0:1787868603.173586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868603.174539:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472512 00000100:00100000:1.0:1787868603.174557:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472512 00000100:00100000:1.0:1787868603.174615:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787868603.174625:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472512:12345-0@lo:41: 00000004:00000024:1.0:1787868603.174664:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787868603.174734:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939472512:12345-0@lo:41: Request processed in 111us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868603.174742:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868603.175107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939472512:0@lo:41: 00010000:00010000:2.0:1787868603.493349:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868604.514952:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787868605.476044:0:9506:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787868605.476048:0:9506:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787868605.476050:0:9506:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787868605.477918:0:9506:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93dabec41000 00000020:01000004:1.0:1787868605.477938:0:9506:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787868605.477952:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787868605.477966:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d986e49a48) 00000020:00000080:1.0:1787868605.477983:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1787868605.549080:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787868605.598935:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787868605.599020:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787868605.656134:0:9506:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787868605.656664:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787868605.656679:0:9506:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787868605.656692:0:9506:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2ceb7 00000020:01000004:0.0:1787868605.656700:0:9506:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787868605.656722:0:9506:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787868605.656725:0:9506:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787868605.656731:0:9506:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787868605.656771:0:9506:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787868605.656775:0:9506:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787868605.684723:0:9506:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787868605.684765:0:9506:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787868605.684769:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787868605.684771:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868605.684772:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868605.684774:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868605.684779:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868605.684781:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868605.684782:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868605.684784:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868605.684785:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868605.684787:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868605.684788:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787868605.684793:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787868605.684795:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868605.684797:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868605.684798:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868605.684799:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868605.684800:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868605.684801:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868605.684802:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868605.684803:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868605.684804:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868605.684805:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868605.684806:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787868605.684834:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787868605.684856:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939472640:0@lo:253: 00000100:00100000:0.0:1787868605.684950:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.685706:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.686044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472640 00000100:00100000:3.0:1787868605.686052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472640 00000100:00100000:3.0:1787868605.686106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787868605.686116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9506:x1874715939472640:12345-0@lo:253: 20000000:01000000:3.0:1787868605.686187:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787868605.686191:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787868605.686196:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787868605.686199:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787868605.686462:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868605.686604:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787868605.686619:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787868605.686638:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787868605.686644:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787868605.686656:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787868605.686671:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787868605.686764:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787868605.686778:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:3.0:1787868605.686780:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:3.0:1787868605.686791:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787868605.686795:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787868605.686806:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787868605.686811:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:3.0:1787868605.686821:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787868605.686827:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787868605.686850:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787868605.686865:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787868605.686945:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787868605.686955:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:3.0:1787868605.686957:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:3.0:1787868605.686968:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787868605.686972:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787868605.686982:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787868605.686986:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:3.0:1787868605.686997:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787868605.687001:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787868605.687011:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787868605.687023:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787868605.687477:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787868605.687489:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:3.0:1787868605.687491:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:3.0:1787868605.687503:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787868605.687508:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787868605.687520:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787868605.687525:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:3.0:1787868605.687535:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787868605.687541:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787868605.687551:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787868605.687565:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787868605.687577:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787868605.687580:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787868605.687584:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787868605.687629:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787868605.687632:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868605.692011:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868605.692073:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868605.692086:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787868605.693080:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787868605.693109:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787868605.693125:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1787868605.693136:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787868605.693139:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787868605.695741:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1787868605.695800:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1787868605.695818:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1787868605.697200:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1787868605.697235:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1787868605.697266:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1787868605.697278:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787868605.697281:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868605.698584:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868605.698618:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868605.698634:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787868605.698900:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787868605.698920:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787868605.698931:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787868605.698941:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787868605.698943:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787868605.699897:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787868605.700117:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787868605.700143:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787868605.700218:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1787868605.700228:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787868605.700230:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787868605.701060:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787868605.701088:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787868605.701104:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787868605.701696:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787868605.701721:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787868605.701735:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1787868605.701754:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787868605.701774:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701793:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701801:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701808:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701815:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701820:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701827:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701979:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.701986:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.702026:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.702043:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.702062:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939472768:0@lo:104: 00000100:00100000:3.0:1787868605.702144:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868605.702730:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.702740:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 21 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.702749:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939472896:0@lo:104: 00000100:00100000:3.0:1787868605.702772:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868605.702843:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.702852:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 21 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.702860:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473024:0@lo:104: 00000100:00100000:3.0:1787868605.702896:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868605.703205:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.703215:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 21 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.703224:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473152:0@lo:104: 00000100:00100000:3.0:1787868605.703264:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.705995:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472768 00000100:00100000:2.0:1787868605.706009:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472768 00000100:00100000:2.0:1787868605.706077:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939472896 00000100:00100000:2.0:1787868605.706080:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939472896 00000100:00100000:2.0:1787868605.706088:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473024 00000100:00100000:2.0:1787868605.706090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473024 00000100:00100000:2.0:1787868605.706104:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868605.706113:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6506:x1874715939472768:12345-0@lo:104: 00010000:00010000:2.0:1787868605.706132:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.706615:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868605.706622:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:6506:x1874715939472768:12345-0@lo:104: Request processed in 510us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.706631:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868605.706653:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868605.706660:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939472896:12345-0@lo:104: 00010000:00010000:2.0:1787868605.706669:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.706706:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787868605.706710:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939472896:12345-0@lo:104: Request processed in 52us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.706716:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868605.706748:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868605.706755:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939473024:12345-0@lo:104: 00010000:00010000:2.0:1787868605.706763:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.706803:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787868605.706808:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939473024:12345-0@lo:104: Request processed in 55us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.706813:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787868605.707054:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.707069:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 21 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.707084:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473280:0@lo:104: 00000100:00100000:3.0:1787868605.707123:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868605.707143:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.707756:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787868605.707766:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.707776:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868605.707781:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.707793:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868605.707801:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868605.707806:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787868605.708040:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473152 00000100:00100000:0.0:1787868605.708046:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473152 00000100:00100000:0.0:1787868605.708077:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473280 00000100:00100000:0.0:1787868605.708078:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473280 00000100:00100000:0.0:1787868605.708090:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868605.708096:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939473152:12345-0@lo:104: 00010000:00010000:0.0:1787868605.708106:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.708295:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 21 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.708308:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473408:0@lo:104: 00010000:00010000:2.0:1787868605.708421:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708429:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868605.708447:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708469:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2200/0x2f11f4d3bde2cea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cea9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708485:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868605.708488:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708494:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070a00 already unused, calling callback (ffffffffc142ec20) 00010000:00010000:0.0:1787868605.708621:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787868605.708628:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939473152:12345-0@lo:104: Request processed in 532us (5364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.708643:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868605.708666:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868605.708673:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939473280:12345-0@lo:104: 00010000:00010000:0.0:1787868605.708680:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.708744:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939473536:0@lo:103: 10000000:00010000:2.0:1787868605.708775:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708783:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868605.708790:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868605.708795:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868605.708817:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708823:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868605.708828:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708846:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2070a00/0x2f11f4d3bde2ce78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708858:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868605.708879:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708886:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868605.708889:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708895:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868605.708901:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868605.708906:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868605.708921:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708927:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868605.708942:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708948:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2ce5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708957:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868605.708960:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708965:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20fe200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868605.708967:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.708984:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868605.708991:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868605.708996:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868605.709011:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.709016:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868605.709022:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.709029:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac20fe200/0x2f11f4d3bde2ce32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.709041:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868605.709043:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868605.709045:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868605.709054:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868605.709060:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868605.709068:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939473664:0@lo:103: 00000100:00100000:3.0:1787868605.709282:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868605.709332:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.709343:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 21 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.709363:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939474048:0@lo:104: 00000100:00100000:3.0:1787868605.709384:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e106c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.709419:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939472768:0@lo:104: 00000100:00100000:3.0:1787868605.709430:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939472896:0@lo:104: 00000100:00100000:3.0:1787868605.709437:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473024:0@lo:104: 00000100:00100000:3.0:1787868605.709445:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473152:0@lo:104: 00010000:00010000:0.0:1787868605.709772:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868605.709779:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939473280:12345-0@lo:104: Request processed in 1107us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.709787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868605.709811:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787868605.709827:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.709844:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473408 00000100:00100000:0.0:1787868605.709849:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473408 00000100:00100000:3.0:1787868605.710058:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473280:0@lo:104: 00000100:00100000:0.0:1787868605.710098:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474048 00000100:00100000:0.0:1787868605.710102:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474048 00000100:00100000:0.0:1787868605.710119:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868605.710125:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939473408:12345-0@lo:104: 00010000:00010000:0.0:1787868605.710135:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.710222:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939473792:0@lo:103: 00000100:00100000:3.0:1787868605.710257:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.710289:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868605.710295:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939473920:0@lo:103: 00000100:00100000:3.0:1787868605.710314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868605.710631:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787868605.710638:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6506:x1874715939473408:12345-0@lo:104: Request processed in 513us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.710645:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868605.710682:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787868605.710689:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939474048:12345-0@lo:104: 00010000:00010000:0.0:1787868605.710707:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.710736:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787868605.710741:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6506:x1874715939474048:12345-0@lo:104: Request processed in 53us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.710747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868605.710812:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939473408:0@lo:104: 00000100:00100000:3.0:1787868605.710819:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874715939474048:0@lo:104: 00010000:00010000:3.0:1787868605.710860:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.711040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.711124:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473792 00000100:00100000:3.0:1787868605.711129:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473792 00010000:00010000:3.0:1787868605.711179:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 22 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.711200:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473920 00000100:00100000:3.0:1787868605.711204:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473920 00010000:00010000:3.0:1787868605.711215:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 23 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.711233:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473536 00000100:00100000:3.0:1787868605.711236:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473536 00010000:00010000:3.0:1787868605.711246:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 24 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.711257:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868605.711262:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939473792:12345-0@lo:103: 00010000:00010000:3.0:1787868605.711273:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868605.711278:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 24 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.711288:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 24 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.711306:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2ce63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce5c expref: 24 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.711532:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868605.711547:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:3636:x1874715939473920:12345-0@lo:103: 00010000:00010000:1.0:1787868605.711557:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868605.711561:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 23 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711570:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 23 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711580:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2ce39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce32 expref: 23 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711593:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868605.711631:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:3636:x1874715939473920:12345-0@lo:103: Request processed in 85us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868605.711637:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868605.711652:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868605.711658:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3638:x1874715939473536:12345-0@lo:103: 00010000:00010000:1.0:1787868605.711665:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868605.711669:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711678:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711687:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2cea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cea2 expref: 21 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.711695:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868605.711723:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3638:x1874715939473536:12345-0@lo:103: Request processed in 65us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868605.711739:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868605.711771:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939473536:0@lo:103: 00010000:00010000:3.0:1787868605.711933:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868605.711963:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3636:x1874715939473792:12345-0@lo:103: Request processed in 700us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.711970:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787868605.712064:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939473920:0@lo:103: 00000100:00100000:0.0:1787868605.712073:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939473792:0@lo:103: 00010000:00010000:0.0:1787868605.712270:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787868605.712277:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712285:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868605.712289:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712298:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868605.712305:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868605.712311:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868605.712356:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712362:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868605.712393:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712411:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a800/0x2f11f4d3bde2ce16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712424:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868605.712428:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712433:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868605.712436:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712442:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868605.712448:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868605.712453:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868605.712469:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712475:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868605.712480:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712486:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2cdd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdde expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712505:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868605.712515:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712521:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868605.712524:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712531:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868605.712536:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868605.712541:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868605.712556:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712562:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868605.712572:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712578:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3e00/0x2f11f4d3bde2cdad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdb4 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712591:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868605.712593:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868605.712594:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868605.712602:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868605.712613:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939474432:0@lo:103: 00000100:00100000:0.0:1787868605.712651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.712683:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474432 00000100:00100000:0.0:1787868605.712693:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474432 00010000:00010000:0.0:1787868605.712714:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 19 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868605.712735:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868605.712742:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3637:x1874715939474432:12345-0@lo:103: 00010000:00010000:0.0:1787868605.712751:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868605.712755:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 19 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712763:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 19 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712774:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2cdb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdad expref: 19 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.712783:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868605.712813:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3637:x1874715939474432:12345-0@lo:103: Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.712818:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868605.713060:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939474432:0@lo:103: 00000100:00100000:2.0:1787868605.713708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.713759:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939474304:0@lo:103: 00000100:00100000:2.0:1787868605.713781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.713952:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939474176:0@lo:103: 00000100:00100000:1.0:1787868605.714046:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939473664 00000100:00100000:1.0:1787868605.714052:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939473664 00010000:00010000:1.0:1787868605.714075:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 18 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.714091:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474304 00000100:00100000:1.0:1787868605.714094:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474304 00010000:00010000:1.0:1787868605.714104:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 19 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.714115:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787868605.714122:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3639:x1874715939473664:12345-0@lo:103: 00010000:00010000:1.0:1787868605.714132:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868605.714137:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 19 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714187:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 19 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714202:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d2000/0x2f11f4d3bde2ce7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce78 expref: 19 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714213:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868605.714247:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3639:x1874715939473664:12345-0@lo:103: Request processed in 125us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868605.714253:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787868605.714267:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787868605.714281:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939474304:12345-0@lo:103: 00010000:00010000:1.0:1787868605.714290:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868605.714294:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714301:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714311:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2cdde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdd7 expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.714331:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868605.714356:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939474304:12345-0@lo:103: Request processed in 76us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868605.714362:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787868605.714758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868605.714764:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868605.715074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.715211:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939474304:0@lo:103: 00000100:00100000:2.0:1787868605.715221:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939473664:0@lo:103: 00000100:00100000:1.0:1787868605.715618:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474176 00000100:00100000:1.0:1787868605.715624:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474176 00010000:00010000:1.0:1787868605.715649:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.715741:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787868605.715749:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3638:x1874715939474176:12345-0@lo:103: 00010000:00010000:1.0:1787868605.715762:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868605.715767:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715778:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715793:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d3800/0x2f11f4d3bde2ce1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce16 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715819:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715828:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715919:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715927:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715934:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715941:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715947:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868605.715952:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715960:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715982:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.715994:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868605.716049:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3638:x1874715939474176:12345-0@lo:103: Request processed in 301us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868605.716066:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787868605.716125:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939474176:0@lo:103: 00010000:00010000:3.0:1787868605.716294:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.716303:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.716335:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80031a00/0x2f11f4d3bde2cebe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787868605.716352:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787868605.718908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:9506:x1874715939472640:12345-0@lo:253: Request processed in 32782us (33947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.718924:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787868605.719075:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939472640:0@lo:253: 10000000:01000000:2.0:1787868605.719089:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787868605.719092:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787868605.719094:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787868605.719095:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868605.719096:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787868605.719097:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868605.719099:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868605.719100:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787868605.719102:0:9506:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787868605.719103:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868605.719104:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787868605.719128:0:9506:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dabec41000 from lustre-OST0001 10000000:01000000:2.0:1787868605.719200:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787868605.719203:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787868605.719212:0:9506:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93daae688000 local copy 10000000:01000000:2.0:1787868605.719215:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787868605.719253:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.719265:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.719274:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868605.719309:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474560:0@lo:101: 00000100:00100000:2.0:1787868605.719365:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.719413:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.720197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474560 00000100:00100000:3.0:1787868605.720206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474560 00000100:00100000:3.0:1787868605.720258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787868605.720268:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+14:9506:x1874715939474560:12345-0@lo:101: 00010000:00010000:3.0:1787868605.720285:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868605.720305:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cec5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.720519:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cec5 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.720539:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cec5 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.720548:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031600, rc 0) 00000100:00100000:3.0:1787868605.720644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939474560:12345-0@lo:101: Request processed in 377us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.720651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787868605.721663:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474560:0@lo:101: 00010000:00010000:2.0:1787868605.721688:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.721699:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.721965:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474688:0@lo:501: 00000100:00100000:3.0:1787868605.722014:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.722076:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.722124:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474688 00000100:00100000:2.0:1787868605.722130:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474688 00000100:00100000:2.0:1787868605.722606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787868605.722618:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939474688:12345-0@lo:501: 00000100:00100000:2.0:1787868605.722712:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939474688:12345-0@lo:501: Request processed in 97us (698us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787868605.722720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787868605.722787:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474688:0@lo:501: 10000000:01000000:3.0:1787868605.722805:0:9506:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787868605.722823:0:9506:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787868605.722830:0:9506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.722851:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.722859:0:9506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.722884:0:9506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868605.722910:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93dabec41000 10000000:01000000:3.0:1787868605.722916:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787868605.722922:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787868605.722924:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787868605.722929:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787868605.722933:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787868605.722956:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.722963:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.722972:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.722986:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474816:0@lo:101: 00000100:00100000:3.0:1787868605.723024:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868605.723119:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868605.723127:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.723135:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868605.723139:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.723178:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868605.723186:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868605.723192:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868605.723212:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.723218:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868605.723236:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.723242:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2cec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f11f4d3bde2cecc expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.723255:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868605.723256:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868605.723258:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868605.724516:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.724807:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474816 00000100:00100000:0.0:1787868605.724814:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474816 00000100:00100000:0.0:1787868605.724872:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787868605.724882:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939474816:12345-0@lo:101: 00010000:00010000:0.0:1787868605.724896:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868605.724914:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ced3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.724957:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.724969:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.724979:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2071c00, rc 0) 00000100:00100000:0.0:1787868605.725038:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939474816:12345-0@lo:101: Request processed in 158us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.725046:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787868605.725109:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939474944:0@lo:103: 00000100:00100000:0.0:1787868605.725144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.725213:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939474944 00000100:00100000:0.0:1787868605.725217:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939474944 00000100:00100000:0.0:1787868605.725246:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868605.725253:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3637:x1874715939474944:12345-0@lo:103: 00010000:00010000:0.0:1787868605.725263:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868605.725277:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80031600/0x2f11f4d3bde2cecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cec5 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.725288:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868605.726077:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939474944:12345-0@lo:103: Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.726089:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868605.726629:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939474944:0@lo:103: 00000100:00100000:3.0:1787868605.726746:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939474816:0@lo:101: 00010000:00010000:3.0:1787868605.726767:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.726778:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.726947:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475072:0@lo:501: 00000100:00100000:3.0:1787868605.726993:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.727063:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.727210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475072 00000100:00100000:2.0:1787868605.727217:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475072 00000100:00100000:0.0:1787868605.727692:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787868605.727717:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475072:12345-0@lo:501: 00000100:00100000:0.0:1787868605.727953:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475072:12345-0@lo:501: Request processed in 238us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.727960:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787868605.728748:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475072:0@lo:501: 00000100:00100000:3.0:1787868605.728799:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475200:0@lo:503: 00000100:00100000:3.0:1787868605.728936:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.728973:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.729034:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475200 00000100:00100000:0.0:1787868605.729040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475200 00000100:00100000:0.0:1787868605.729085:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787868605.729095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475200:12345-0@lo:503: 00000100:00100000:3.0:1787868605.729692:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475200:0@lo:503: 00000040:00080000:3.0:1787868605.729981:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868605.730057:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475328:0@lo:502: 00000100:00100000:3.0:1787868605.734661:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.734717:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.734826:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475200:12345-0@lo:503: Request processed in 5730us (5886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.734849:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787868605.734908:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475328 00000100:00100000:0.0:1787868605.734916:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475328 00000100:00100000:0.0:1787868605.734955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787868605.734963:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475328:12345-0@lo:502: 00000100:00100000:0.0:1787868605.735100:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475328:12345-0@lo:502: Request processed in 137us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.735107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787868605.735469:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475328:0@lo:502: 00000040:00080000:3.0:1787868605.735903:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787868605.735937:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787868605.735952:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787868605.735962:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787868605.735985:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787868605.735997:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787868605.736032:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475456:0@lo:502: 00000100:00100000:3.0:1787868605.736082:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.736113:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.736492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475456 00000100:00100000:0.0:1787868605.736506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475456 00000100:00100000:0.0:1787868605.736543:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787868605.736552:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475456:12345-0@lo:502: 00000100:00100000:0.0:1787868605.736655:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475456:12345-0@lo:502: Request processed in 104us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.736661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787868605.736996:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475456:0@lo:502: 00000040:00080000:3.0:1787868605.737059:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787868605.737071:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787868605.738315:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787868605.738415:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787868605.738440:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868605.738442:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787868605.738451:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868605.738468:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d9863d3490) 00000020:00000080:0.0:1787868605.738609:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787868605.738618:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787868605.738710:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dabec41000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787868605.738720:0:9517:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787868605.738727:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2cee8 00010000:00010000:0.0:1787868605.746062:0:9517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787868605.746757:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787868605.750737:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787868605.751091:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787868605.758054:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787868605.759410:0:9517:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787868605.768564:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787868605.778061:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787868605.778078:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868605.778085:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868605.778087:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787868605.778092:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868605.778097:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868605.778098:0:9517:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787868605.778102:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868605.778103:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787868605.778138:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868605.778141:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868605.778143:0:9517:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787868605.778471:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787868605.778712:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787868605.778742:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787868605.778757:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.778769:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868605.778777:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dabec41000 from 1 10000000:01000000:3.0:1787868605.778780:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868605.778815:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.778822:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.778833:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.778855:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475584:0@lo:101: 00000100:00100000:3.0:1787868605.778922:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.778986:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.780293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475584 00000100:00100000:0.0:1787868605.780306:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475584 00000100:00100000:0.0:1787868605.780386:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787868605.780407:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:9506:x1874715939475584:12345-0@lo:101: 00010000:00010000:0.0:1787868605.780442:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868605.780461:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ceef expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.780742:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.780759:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.780768:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2070a00, rc 0) 00000100:00100000:0.0:1787868605.780926:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475584:12345-0@lo:101: Request processed in 530us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.780935:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787868605.784479:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475584:0@lo:101: 00010000:00010000:1.0:1787868605.784537:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868605.784550:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868605.784711:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475712:0@lo:501: 00000100:00100000:1.0:1787868605.784771:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868605.784825:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.785122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475712 00000100:00100000:0.0:1787868605.785131:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475712 00000100:00100000:0.0:1787868605.785237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787868605.785248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475712:12345-0@lo:501: 00000100:00100000:0.0:1787868605.785394:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475712:12345-0@lo:501: Request processed in 148us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.785425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787868605.785492:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475712:0@lo:501: 00000100:00100000:0.0:1787868605.785721:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475840:0@lo:503: 00000100:00100000:0.0:1787868605.785767:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.787217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475840 00000100:00100000:2.0:1787868605.787231:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475840 00000100:00100000:2.0:1787868605.787281:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787868605.787291:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475840:12345-0@lo:503: 00000100:00100000:2.0:1787868605.787450:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475840:12345-0@lo:503: Request processed in 160us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.787638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787868605.787981:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787868605.788012:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475840:0@lo:503: 00000040:00080000:2.0:1787868605.789018:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787868605.789118:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475968:0@lo:502: 00000100:00100000:3.0:1787868605.793998:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.794056:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.794270:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939475968 00000100:00100000:2.0:1787868605.794294:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939475968 00000100:00100000:2.0:1787868605.794628:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868605.794641:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475968:12345-0@lo:502: 00000100:00100000:2.0:1787868605.794807:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939475968:12345-0@lo:502: Request processed in 168us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.794816:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787868605.794851:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939475968:0@lo:502: 00000040:00080000:3.0:1787868605.795117:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787868605.795152:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787868605.795208:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476096:0@lo:502: 00000100:00100000:3.0:1787868605.795268:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.795298:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.795315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476096 00000100:00100000:2.0:1787868605.795332:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476096 00000100:00100000:2.0:1787868605.795368:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868605.795376:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939476096:12345-0@lo:502: 00000100:00100000:2.0:1787868605.795469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939476096:12345-0@lo:502: Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.795475:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787868605.795777:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476096:0@lo:502: 00000040:00080000:3.0:1787868605.795821:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787868605.795830:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787868605.797062:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868605.797073:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868605.797076:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787868605.797083:0:9521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dabec41000 00000020:00000080:3.0:1787868605.797086:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868605.797098:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868605.797101:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868605.797102:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787868605.797106:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787868605.797256:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787868605.797284:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787868605.797303:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.797842:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868605.797920:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787868605.797923:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93dabec41000 10000000:01000000:2.0:1787868605.797926:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93dabec41000 10000000:01000000:2.0:1787868605.797930:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787868605.797935:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dabec41000 from 1 10000000:01000000:2.0:1787868605.797939:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787868605.797973:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.797999:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.798011:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868605.798034:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476224:0@lo:101: 00000100:00100000:2.0:1787868605.798095:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.798131:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.798228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476224 00000100:00100000:3.0:1787868605.798236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476224 00000100:00100000:3.0:1787868605.798286:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787868605.798295:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9506:x1874715939476224:12345-0@lo:101: 00010000:00010000:3.0:1787868605.798307:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868605.798328:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cefd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.798351:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.798371:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.798381:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030a00, rc 0) 00000100:00100000:3.0:1787868605.798444:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476224:12345-0@lo:101: Request processed in 139us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.798452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787868605.798933:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476224:0@lo:101: 00010000:00010000:2.0:1787868605.798949:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.798957:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868605.799048:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476352:0@lo:501: 00000100:00100000:2.0:1787868605.799080:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.799108:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.799448:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476352 00000100:00100000:3.0:1787868605.799453:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476352 00000100:00100000:3.0:1787868605.799505:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787868605.799515:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476352:12345-0@lo:501: 00000100:00100000:3.0:1787868605.799628:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476352:12345-0@lo:501: Request processed in 115us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.799636:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787868605.799830:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476352:0@lo:501: 00000100:00100000:2.0:1787868605.799876:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476480:0@lo:503: 00000100:00100000:2.0:1787868605.799924:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.799951:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.800200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476480 00000100:00100000:3.0:1787868605.800205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476480 00000100:00100000:3.0:1787868605.800701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787868605.800715:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476480:12345-0@lo:503: 00000100:00100000:3.0:1787868605.800847:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476480:12345-0@lo:503: Request processed in 136us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.800855:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787868605.801071:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476480:0@lo:503: 00000040:00080000:2.0:1787868605.801487:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787868605.801911:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476608:0@lo:502: 00000100:00100000:2.0:1787868605.801959:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.801985:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.802116:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476608 00000100:00100000:3.0:1787868605.802122:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476608 00000100:00100000:3.0:1787868605.802282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787868605.802292:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476608:12345-0@lo:502: 00000100:00100000:3.0:1787868605.802685:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476608:12345-0@lo:502: Request processed in 393us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.802711:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787868605.802960:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476608:0@lo:502: 00000040:00080000:2.0:1787868605.803470:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787868605.803807:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787868605.803826:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787868605.803915:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787868605.803927:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787868605.803938:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787868605.803948:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787868605.803958:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787868605.803969:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787868605.803978:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787868605.803988:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787868605.803999:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787868605.804008:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787868605.804019:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787868605.804029:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787868605.804040:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787868605.804050:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787868605.804071:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787868605.804083:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787868605.804093:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787868605.804103:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787868605.804113:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787868605.804124:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787868605.804134:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787868605.804312:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787868605.804339:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787868605.804350:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787868605.804370:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787868605.804381:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787868605.804392:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787868605.804414:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787868605.804426:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787868605.804445:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787868605.804466:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787868605.804487:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787868605.804506:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787868605.804522:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787868605.804534:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787868605.804547:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787868605.804561:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787868605.804575:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787868605.804588:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787868605.804600:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787868605.804612:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787868605.804624:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787868605.804636:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787868605.804681:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476736:0@lo:502: 00000100:00100000:2.0:1787868605.804764:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.804802:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868605.806139:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476736 00000100:00100000:3.0:1787868605.806149:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476736 00000100:00100000:3.0:1787868605.806228:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787868605.806238:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476736:12345-0@lo:502: 00000100:00100000:3.0:1787868605.806416:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939476736:12345-0@lo:502: Request processed in 179us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.806423:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787868605.806681:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939476736:0@lo:502: 00000040:00080000:1.0:1787868605.806870:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787868605.806886:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787868605.812754:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787868605.812774:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93dab59f1a48) 00000020:00000080:2.0:1787868605.812800:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787868605.813671:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dabec41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787868605.813679:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dabec41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787868605.813681:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dabec41000 3 00010000:00080000:2.0:1787868605.813726:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dabec6f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787868605.819309:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787868605.827351:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787868605.827439:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787868605.827454:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2f11f4d3bde2cf12 00000100:00080000:2.0:1787868605.827466:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868605.827483:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93dabec6f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868605.827970:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed0b840 x1874715939476864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868605.827990:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787868605.829922:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939476864:0@lo:38: 00000100:00100000:0.0:1787868605.830016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.831032:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476864 00000100:00100000:2.0:1787868605.831043:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476864 00000100:00100000:2.0:1787868605.831092:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787868605.831100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939476864:12345-0@lo:38: 00010000:00080000:2.0:1787868605.831132:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1787868605.831213:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2cf19 00000004:00100000:2.0:1787868605.831233:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787868605.831272:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dabec6a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868605.831345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874715939476864:12345-0@lo:38: Request processed in 245us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.831352:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787868605.831415:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabed0b840 x1874715939476864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868605.831426:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787868605.831442:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787868605.831450:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787868605.831455:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787868605.831457:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787868605.831463:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939476864:0@lo:38: 00000020:01000004:2.0:1787868605.831813:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787868605.831853:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93d988021a48) 00000020:00000080:2.0:1787868605.831875:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1787868605.831957:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dabec41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787868605.831962:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dabec41000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787868605.831964:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dabec41000 3 00010000:00080000:2.0:1787868605.831991:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dabd86f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:0.0:1787868605.833025:0:9523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1874715939476992:0@lo:901: 00000100:00100000:0.0:1787868605.833084:0:9523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.833133:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939476992 00000100:00100000:0.0:1787868605.833138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939476992 00000100:00100000:0.0:1787868605.833255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868605.833264:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1874715939476992:12345-0@lo:901: 00000100:00100000:0.0:1787868605.833357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1874715939476992:12345-0@lo:901: Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.833364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868605.833387:0:9523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f49c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787868605.833418:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f94f00 x1874715939476992/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787868621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868605.833442:0:9523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1874715939476992:0@lo:901: 00000100:00080000:3.0:1787868605.837387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868605.837626:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868605.837652:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939477120:0@lo:400: 00000100:00100000:3.0:1787868605.837733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.837790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477120 00000100:00100000:3.0:1787868605.837798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477120 00000100:00100000:3.0:1787868605.839299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868605.839320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939477120:12345-0@lo:400: 00000100:00100000:3.0:1787868605.839431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939477120:12345-0@lo:400: Request processed in 118us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.839437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787868605.839489:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52d00 x1874715939477120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.840337:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939477120:0@lo:400: 00000100:00100000:3.0:1787868605.840428:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868605.841259:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939477248:0@lo:400: 00000100:00100000:3.0:1787868605.841318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.841367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477248 00000100:00100000:3.0:1787868605.841380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477248 00000100:00100000:3.0:1787868605.841445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868605.841454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939477248:12345-0@lo:400: 00000100:00100000:3.0:1787868605.842754:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939477248:12345-0@lo:400: Request processed in 1295us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.842765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868605.842853:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939477376:0@lo:400: 00000100:00100000:3.0:1787868605.842895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.842936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477376 00000100:00100000:3.0:1787868605.842942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477376 00000100:00100000:3.0:1787868605.842975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868605.842984:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939477376:12345-0@lo:400: 00000100:00100000:3.0:1787868605.843025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939477376:12345-0@lo:400: Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.843031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787868605.843067:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52580 x1874715939477376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.843081:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939477376:0@lo:400: 00000100:00100000:3.0:1787868605.843136:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939477504:0@lo:400: 00000100:00100000:3.0:1787868605.843200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.843231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477504 00000100:00100000:3.0:1787868605.843235:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477504 00000100:00100000:3.0:1787868605.843257:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868605.843264:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939477504:12345-0@lo:400: 00000100:00100000:3.0:1787868605.843299:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939477504:12345-0@lo:400: Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.843316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868605.843344:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939477504:0@lo:400: 00000100:00100000:3.0:1787868605.843374:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868605.843383:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939477632:0@lo:400: 00000100:00100000:3.0:1787868605.843419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.843449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477632 00000100:00100000:3.0:1787868605.843453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477632 00000100:00100000:3.0:1787868605.843484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868605.843491:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939477632:12345-0@lo:400: 00000100:00100000:3.0:1787868605.843535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939477632:12345-0@lo:400: Request processed in 45us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.843542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787868605.843557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787868605.843576:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52580 x1874715939477632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.843586:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939477632:0@lo:400: 00000100:00100000:3.0:1787868605.843614:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939477760:0@lo:400: 00000100:00100000:3.0:1787868605.843636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.843660:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477760 00000100:00100000:3.0:1787868605.843663:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477760 00000100:00100000:3.0:1787868605.843688:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787868605.843694:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939477760:12345-0@lo:400: 00000100:00100000:3.0:1787868605.843724:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939477760:12345-0@lo:400: Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.843729:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787868605.843748:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868605.843764:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52580 x1874715939477760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.843772:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939477760:0@lo:400: 00000100:00100000:3.0:1787868605.843804:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939477888:0@lo:400: 00000100:00100000:3.0:1787868605.843828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.843860:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939477888 00000100:00100000:3.0:1787868605.843864:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939477888 00000100:00100000:3.0:1787868605.843894:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868605.843901:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939477888:12345-0@lo:400: 00000100:00100000:3.0:1787868605.843934:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939477888:12345-0@lo:400: Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.843939:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787868605.843953:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868605.843987:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52580 x1874715939477888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.843997:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939477888:0@lo:400: 00000100:00100000:3.0:1787868605.844110:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939478016:0@lo:400: 00000100:00100000:3.0:1787868605.844134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.844181:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478016 00000100:00100000:3.0:1787868605.844185:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478016 00000100:00100000:3.0:1787868605.844214:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868605.844220:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939478016:12345-0@lo:400: 00000100:00100000:3.0:1787868605.844252:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939478016:12345-0@lo:400: Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.844257:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787868605.844279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868605.844305:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987c52580 x1874715939478016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868605.844315:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939478016:0@lo:400: 00010000:00010000:2.0:1787868605.844861:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1787868605.845063:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787868605.845112:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787868605.845125:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2f11f4d3bde2cf27 00000100:00080000:2.0:1787868605.845133:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868605.845139:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93dabd86f000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868605.845204:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed0b840 x1874715939478144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868605.845227:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787868605.846041:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939478144:0@lo:38: 00000100:00100000:3.0:1787868605.846103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868605.846346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478144 00000100:00100000:2.0:1787868605.846353:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478144 00000100:00100000:2.0:1787868605.846417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787868605.846424:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939478144:12345-0@lo:38: 00010000:00080000:2.0:1787868605.847388:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1787868605.847552:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2cf2e 00000004:00100000:2.0:1787868605.847570:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787868605.847606:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868605.847691:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874715939478144:12345-0@lo:38: Request processed in 1261us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868605.847702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787868605.847777:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabed0b840 x1874715939478144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868605.847789:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787868605.847798:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787868605.847806:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787868605.847810:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787868605.847812:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabd86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787868605.847818:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939478144:0@lo:38: 00000040:00080000:2.0:1787868605.847942:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1787868605.848369:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939477248:0@lo:400: 00000020:01000000:0.0:1787868605.849619:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787868605.849663:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868605.849677:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.849690:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868605.849738:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787868605.849741:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868605.849742:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868605.849743:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868605.849749:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868605.849750:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868605.849752:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868605.849753:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868605.849754:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868605.849756:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868605.849757:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868605.849760:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787868605.849762:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868605.849763:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868605.849765:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868605.849765:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868605.849766:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868605.849767:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868605.849768:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868605.849769:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868605.849770:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868605.849771:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868605.849772:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868605.849794:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787868605.849811:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939478272:0@lo:253: 00000100:00100000:0.0:1787868605.849875:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.849910:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.849983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478272 00000100:00100000:2.0:1787868605.849990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478272 00000100:00100000:2.0:1787868605.850043:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787868605.850052:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939478272:12345-0@lo:253: 20000000:01000000:2.0:1787868605.850080:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787868605.850095:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787868605.868544:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787868605.868567:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787868605.868758:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787868605.868764:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787868605.868788:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.868807:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.868815:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.868821:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.868879:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.868894:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868605.868910:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939478400:0@lo:104: 00000100:00100000:0.0:1787868605.868975:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868605.869024:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.869032:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868605.869040:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939478528:0@lo:104: 00000100:00100000:0.0:1787868605.869062:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.869089:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868605.869187:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478400 00000100:00100000:1.0:1787868605.869189:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478528 00000100:00100000:2.0:1787868605.869194:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478400 00000100:00100000:1.0:1787868605.869194:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478528 00000100:00100000:2.0:1787868605.869232:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868605.869247:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939478400:12345-0@lo:104: 00010000:00010000:2.0:1787868605.869259:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868605.869312:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868605.869318:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:6528:x1874715939478400:12345-0@lo:104: Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.869470:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9506:x1874715939478272:12345-0@lo:253: Request processed in 19419us (19595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.869479:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787868605.869539:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9506:1874715939478272:0@lo:253: 10000000:01000000:0.0:1787868605.869550:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787868605.869553:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868605.869555:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868605.869557:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868605.869558:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868605.869559:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868605.869560:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868605.869562:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868605.869571:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787868605.869572:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787868605.869574:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868605.869575:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787868605.869590:0:9506:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787868605.873418:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939478400:0@lo:104: 00010000:00010000:3.0:1787868605.875273:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868605.875287:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875299:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868605.875304:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875314:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868605.875321:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868605.875327:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787868605.875381:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875388:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868605.875422:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875445:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2ce6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875460:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868605.875462:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868605.875464:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868605.875475:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868605.875535:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939478656:0@lo:103: 00000100:00100000:3.0:1787868605.875607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868605.875666:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478656 00000100:00100000:3.0:1787868605.875673:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478656 00010000:00010000:3.0:1787868605.875700:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.875729:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868605.875739:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939478656:12345-0@lo:103: 00010000:00010000:3.0:1787868605.875753:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868605.875758:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875769:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.875993:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d2600/0x2f11f4d3bde2ce71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce6a expref: 17 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.876008:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868605.876044:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939478656:12345-0@lo:103: Request processed in 306us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.876058:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868605.876098:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939478656:0@lo:103: 00080000:10000000:0.0:1787868605.878376:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787868605.878582:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787868605.878778:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787868605.878929:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787868605.879136:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787868605.879389:0:9506:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1787868605.880976:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868605.881324:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868605.881341:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939478528:12345-0@lo:104: 00010000:00010000:3.0:1787868605.881362:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868605.881489:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874715939478528:0@lo:104: 00010000:00010000:3.0:1787868605.881583:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.881609:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787868605.881616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:6528:x1874715939478528:12345-0@lo:104: Request processed in 283us (12553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868605.881623:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787868605.883420:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868605.883429:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.883440:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20fec00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868605.883444:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.883452:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868605.883459:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868605.883471:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787868605.883526:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.883533:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868605.883554:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.883561:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac20fec00/0x2f11f4d3bde2ce24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ce2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868605.883582:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868605.883584:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868605.883585:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868605.883603:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939478784:0@lo:103: 00000100:00100000:3.0:1787868605.883666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868605.883838:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478784 00000100:00100000:0.0:1787868605.883846:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478784 00010000:00010000:0.0:1787868605.883875:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868605.883913:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787868605.883922:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939478784:12345-0@lo:103: 00010000:00010000:0.0:1787868605.883934:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868605.883939:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.883951:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.883966:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2ce2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ce24 expref: 16 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.883982:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.883990:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787868605.884015:0:7463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015250871s 00010000:00010000:0.0:1787868605.884019:0:7463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884025:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884031:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884037:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884042:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868605.884045:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884052:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884068:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884078:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868605.884114:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3639:x1874715939478784:12345-0@lo:103: Request processed in 193us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868605.884122:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787868605.884289:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939478784:0@lo:103: 00010000:00010000:0.0:1787868605.884312:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884327:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868605.884333:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2cf35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787868605.884902:0:9506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787868605.894840:0:9506:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787868605.894852:0:9506:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787868605.894892:0:9506:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787868605.894933:0:9506:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787868605.894954:0:9506:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787868605.894973:0:9506:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787868605.897775:0:9506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868605.897990:0:9506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787868606.561552:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868606.904894:0:9578:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868606.905125:0:9578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787868607.588934:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868607.778906:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939478912:0@lo:13: 00000100:00100000:3.0:1787868607.778986:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868607.779061:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939478912 00000100:00100000:3.0:1787868607.779067:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939478912 00000100:00100000:3.0:1787868607.779122:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868607.779132:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939478912:12345-0@lo:13: 00002000:00000024:3.0:1787868607.779231:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868607.779277:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939478912:12345-0@lo:13: Request processed in 147us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868607.779285:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787868607.779304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868607.779343:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c53c00 x1874715939478912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868607.779376:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939478912:0@lo:13: 00000100:00100000:3.0:1787868607.785343:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939479040:0@lo:13: 00000100:00100000:3.0:1787868607.785433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868607.785856:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479040 00000100:00100000:2.0:1787868607.785867:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479040 00000100:00100000:2.0:1787868607.785944:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868607.785955:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939479040:12345-0@lo:13: 00002000:00000024:2.0:1787868607.785980:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868607.786036:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939479040:12345-0@lo:13: Request processed in 82us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868607.786042:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787868607.786093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868607.786132:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0b480 x1874715939479040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868607.786184:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939479040:0@lo:13: 00000100:00100000:3.0:1787868607.786503:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939479168:0@lo:41: 00000100:00100000:3.0:1787868607.786537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868607.786628:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479168 00000100:00100000:0.0:1787868607.786633:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479168 00000100:00100000:0.0:1787868607.786670:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868607.786679:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939479168:12345-0@lo:41: 00000004:00000024:0.0:1787868607.786706:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787868607.786890:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939479168:12345-0@lo:41: Request processed in 213us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868607.786897:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787868607.790948:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939479168:0@lo:41: 00000100:00100000:2.0:1787868608.291522:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868608.291555:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939479296:0@lo:41: 00000100:00100000:2.0:1787868608.291645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868608.291714:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479296 00000100:00100000:2.0:1787868608.291723:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479296 00000100:00100000:2.0:1787868608.291769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868608.291779:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939479296:12345-0@lo:41: 00000004:00000024:2.0:1787868608.291813:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787868608.291859:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939479296:12345-0@lo:41: Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868608.291866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868608.291911:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939479296:0@lo:41: 00010000:00010000:3.0:1787868608.610386:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868609.634425:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868610.663431:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868610.849360:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939479552:0@lo:400: 00000100:00100000:1.0:1787868610.849433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849483:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939480064:0@lo:400: 00000100:00100000:1.0:1787868610.849500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849519:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939480576:0@lo:400: 00000100:00100000:1.0:1787868610.849538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849568:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868610.849573:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939479424:0@lo:400: 00000100:00100000:1.0:1787868610.849598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849637:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939479936:0@lo:400: 00000100:00100000:1.0:1787868610.849661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849676:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939480448:0@lo:400: 00000100:00100000:1.0:1787868610.849695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849717:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939479808:0@lo:400: 00000100:00100000:1.0:1787868610.849749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849760:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939480320:0@lo:400: 00000100:00100000:1.0:1787868610.849778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849794:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787868610.849798:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939479680:0@lo:400: 00000100:00100000:1.0:1787868610.849814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849825:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939480192:0@lo:400: 00000100:00100000:1.0:1787868610.849840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849847:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939480704:0@lo:400: 00000100:00100000:1.0:1787868610.849864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868610.849883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479552 00000100:00100000:1.0:1787868610.849889:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479552 00000100:00100000:1.0:1787868610.849924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480064 00000100:00100000:1.0:1787868610.849927:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480064 00000100:00100000:1.0:1787868610.849947:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480576 00000100:00100000:1.0:1787868610.849949:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480576 00000100:00100000:1.0:1787868610.849961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479808 00000100:00100000:1.0:1787868610.849963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479808 00000100:00100000:1.0:1787868610.849972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480192 00000100:00100000:1.0:1787868610.849973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480192 00000100:00100000:1.0:1787868610.849984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480704 00000100:00100000:1.0:1787868610.849986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480704 00000100:00100000:1.0:1787868610.849999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868610.850007:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939479552:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850062:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939479552:12345-0@lo:400: Request processed in 56us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868610.850085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868610.850090:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939480064:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939480064:12345-0@lo:400: Request processed in 21us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868610.850125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868610.850130:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939480576:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850147:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939480576:12345-0@lo:400: Request processed in 18us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868610.850181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868610.850187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939479808:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850210:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939479808:12345-0@lo:400: Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868610.850224:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868610.850229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939480192:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850247:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939480192:12345-0@lo:400: Request processed in 19us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868610.850260:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787868610.850264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939480704:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939480704:12345-0@lo:400: Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787868610.850331:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479936 00000100:00100000:1.0:1787868610.850334:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479936 00000100:00100000:1.0:1787868610.850350:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479680 00000100:00100000:1.0:1787868610.850352:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479680 00000100:00100000:1.0:1787868610.850362:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787868610.850367:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939479936:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850392:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939479936:12345-0@lo:400: Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850398:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787868610.850406:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787868610.850411:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939479680:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850429:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939479680:12345-0@lo:400: Request processed in 18us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850434:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787868610.850447:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480448 00000100:00100000:1.0:1787868610.850450:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480448 00000100:00100000:1.0:1787868610.850470:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480320 00000100:00100000:1.0:1787868610.850472:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480320 00000100:00100000:1.0:1787868610.850486:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868610.850492:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939480448:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850515:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939480448:12345-0@lo:400: Request processed in 23us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850520:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868610.850528:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868610.850532:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939480320:12345-0@lo:400: 00000100:00100000:1.0:1787868610.850558:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939480320:12345-0@lo:400: Request processed in 26us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868610.850563:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787868610.850579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868610.850582:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868610.850584:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868610.850612:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939479680:0@lo:400: 00010000:00080000:1.0:1787868610.850625:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8fc00 x1874715939480192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850634:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939480192:0@lo:400: 00010000:00080000:1.0:1787868610.850643:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da932b1680 x1874715939480704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850651:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939480704:0@lo:400: 00010000:00080000:1.0:1787868610.850659:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8cb40 x1874715939479808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850667:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939479808:0@lo:400: 00010000:00080000:1.0:1787868610.850675:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8f480 x1874715939480320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850682:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939480320:0@lo:400: 00000100:00100000:1.0:1787868610.850716:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939479936:0@lo:400: 00010000:00080000:1.0:1787868610.850725:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8e940 x1874715939480448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850733:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939480448:0@lo:400: 00010000:00080000:1.0:1787868610.850748:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8c000 x1874715939479552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850755:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939479552:0@lo:400: 00010000:00080000:1.0:1787868610.850763:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8e580 x1874715939480064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850771:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939480064:0@lo:400: 00010000:00080000:1.0:1787868610.850778:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da932b2d00 x1874715939480576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868610.850785:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939480576:0@lo:400: 00000100:00100000:2.0:1787868610.850986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939479424 00000100:00100000:2.0:1787868610.850991:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939479424 00000100:00100000:2.0:1787868610.851018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787868610.851024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939479424:12345-0@lo:400: 00000100:00100000:2.0:1787868610.851061:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3637:x1874715939479424:12345-0@lo:400: Request processed in 38us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868610.851073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787868610.851111:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939479424:0@lo:400: 00010000:00010000:3.0:1787868611.682835:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868612.709791:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787868612.824899:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787868612.897466:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868612.897494:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939480832:0@lo:13: 00000100:00100000:2.0:1787868612.897568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.897646:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939480960:0@lo:13: 00000100:00100000:2.0:1787868612.897672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.897685:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480832 00000100:00100000:0.0:1787868612.897695:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480832 00000100:00100000:2.0:1787868612.897720:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939480960 00000100:00100000:2.0:1787868612.897725:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939480960 00000100:00100000:2.0:1787868612.897758:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868612.897768:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939480960:12345-0@lo:13: 00002000:00000024:2.0:1787868612.897795:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868612.897839:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939480960:12345-0@lo:13: Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.897847:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787868612.897885:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a1c0 x1874715939480960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868612.897903:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939480960:0@lo:13: 00000100:00100000:2.0:1787868612.898015:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939481088:0@lo:41: 00000100:00100000:2.0:1787868612.898043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.898113:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481088 00000100:00100000:3.0:1787868612.898117:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481088 00000100:00100000:3.0:1787868612.898198:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868612.898207:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939481088:12345-0@lo:41: 00000004:00000024:3.0:1787868612.898231:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787868612.898283:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939481088:12345-0@lo:41: Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.898290:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787868612.898427:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939481088:0@lo:41: 00000100:00100000:0.0:1787868612.901792:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787868612.901821:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939480832:12345-0@lo:13: 00002000:00000024:0.0:1787868612.901850:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868612.901949:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939480832:12345-0@lo:13: Request processed in 143us (4380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.901972:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787868612.901994:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c51a40 x1874715939480832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868612.902000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868612.902020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939480832:0@lo:13: 10000000:01000000:2.0:1787868612.902662:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787868612.902666:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab5b24800 from 39 10000000:01000000:2.0:1787868612.902671:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787868612.902716:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.902726:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.903064:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.903089:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481216:0@lo:101: 00000100:00100000:2.0:1787868612.903143:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.903392:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.903845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481216 00000100:00100000:1.0:1787868612.903854:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481216 00000100:00100000:1.0:1787868612.903907:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787868612.903917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939481216:12345-0@lo:101: 00010000:00010000:1.0:1787868612.905083:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868612.905103:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf3c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.905133:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.905145:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.905167:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1aa00, rc 0) 00000100:00100000:1.0:1787868612.905246:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481216:12345-0@lo:101: Request processed in 1330us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868612.905254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787868612.905686:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481216:0@lo:101: 00010000:00010000:3.0:1787868612.905712:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.905723:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868612.905808:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481344:0@lo:501: 00000100:00100000:3.0:1787868612.905846:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.905889:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae6929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.906316:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481344 00000100:00100000:0.0:1787868612.906324:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481344 00000100:00100000:0.0:1787868612.906365:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787868612.906373:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481344:12345-0@lo:501: 00000100:00100000:0.0:1787868612.906658:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481344:12345-0@lo:501: Request processed in 217us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.906667:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868612.910062:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481344:0@lo:501: 00000100:00100000:1.0:1787868612.910122:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481472:0@lo:503: 00000100:00100000:1.0:1787868612.910217:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.910258:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.910436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481472 00000100:00100000:2.0:1787868612.910443:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481472 00000100:00100000:2.0:1787868612.910509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787868612.910525:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481472:12345-0@lo:503: 00000100:00100000:2.0:1787868612.910784:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481472:12345-0@lo:503: Request processed in 264us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.910793:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787868612.910953:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481472:0@lo:503: 00000100:00100000:2.0:1787868612.916058:0:9873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9873:1874715939481600:0@lo:502: 00000100:00100000:2.0:1787868612.916149:0:9873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.916205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481600 00000100:00100000:2.0:1787868612.916209:0:9873:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.916213:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481600 00000100:00100000:1.0:1787868612.916277:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787868612.916288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9873:x1874715939481600:12345-0@lo:502: 00000100:00100000:1.0:1787868612.916551:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9873:x1874715939481600:12345-0@lo:502: Request processed in 264us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868612.916560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787868612.916817:0:9873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9873:1874715939481600:0@lo:502: 00000100:00100000:2.0:1787868612.916867:0:9873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9873:1874715939481728:0@lo:502: 00000100:00100000:2.0:1787868612.916899:0:9873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.916921:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481728 00000100:00100000:2.0:1787868612.916925:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481728 00000100:00100000:2.0:1787868612.916954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787868612.916961:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9873:x1874715939481728:12345-0@lo:502: 00000100:00100000:2.0:1787868612.917034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:9873:x1874715939481728:12345-0@lo:502: Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.917041:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787868612.917072:0:9873:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.917084:0:9873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9873:1874715939481728:0@lo:502: 00000040:00080000:2.0:1787868612.917102:0:9873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787868612.918999:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787868612.919028:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787868612.919039:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.919052:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868612.919062:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787868612.919066:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787868612.919068:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787868612.919102:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.919117:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.919128:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868612.919148:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481856:0@lo:101: 00000100:00100000:1.0:1787868612.919575:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.919601:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.919633:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481856 00000100:00100000:2.0:1787868612.919639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481856 00000100:00100000:2.0:1787868612.919682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787868612.919691:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939481856:12345-0@lo:101: 00010000:00010000:2.0:1787868612.919702:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868612.919715:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.919739:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.919749:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.919757:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868612.919798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939481856:12345-0@lo:101: Request processed in 108us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.919804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787868612.919844:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481856:0@lo:101: 00010000:00010000:2.0:1787868612.919857:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.919877:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.919930:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481984:0@lo:501: 00000100:00100000:2.0:1787868612.919953:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.919969:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.919981:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939481984 00000100:00100000:2.0:1787868612.919984:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939481984 00000100:00100000:2.0:1787868612.920005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787868612.920011:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939481984:12345-0@lo:501: 00000100:00100000:2.0:1787868612.920116:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939481984:12345-0@lo:501: Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.920123:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787868612.920149:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939481984:0@lo:501: 00000100:00100000:2.0:1787868612.920625:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482112:0@lo:503: 00000100:00100000:2.0:1787868612.920665:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.920680:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da98975900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.920693:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482112 00000100:00100000:2.0:1787868612.920696:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482112 00000100:00100000:2.0:1787868612.920717:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787868612.920723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939482112:12345-0@lo:503: 00000100:00100000:2.0:1787868612.920803:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939482112:12345-0@lo:503: Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.920809:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787868612.920848:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482112:0@lo:503: 00000100:00100000:2.0:1787868612.928774:0:9874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9874:1874715939482240:0@lo:502: 00000100:00100000:2.0:1787868612.928865:0:9874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.928975:0:9874:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da98975480 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.931714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482240 00000100:00100000:1.0:1787868612.931728:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482240 00000100:00100000:1.0:1787868612.931837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787868612.931851:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9874:x1874715939482240:12345-0@lo:502: 00000100:00100000:1.0:1787868612.932060:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9874:x1874715939482240:12345-0@lo:502: Request processed in 214us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868612.932070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868612.932189:0:9874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9874:1874715939482240:0@lo:502: 00000020:01000000:0.0:1787868612.932232:0:9874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868612.932242:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868612.932245:0:9874:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787868612.932252:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868612.932254:0:9874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787868612.932296:0:9874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9874:1874715939482368:0@lo:502: 00000100:00100000:0.0:1787868612.932343:0:9874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.932453:0:9874:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.932648:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482368 00000100:00100000:2.0:1787868612.932654:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482368 00000100:00100000:2.0:1787868612.932683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787868612.932691:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9874:x1874715939482368:12345-0@lo:502: 00000100:00100000:2.0:1787868612.932785:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:9874:x1874715939482368:12345-0@lo:502: Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.932792:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787868612.932871:0:9874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9874:1874715939482368:0@lo:502: 00000020:01000000:0.0:1787868612.932893:0:9874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868612.932898:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868612.932899:0:9874:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787868612.932903:0:9874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787868612.933920:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787868612.934327:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787868612.934339:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.934351:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868612.934360:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787868612.934363:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daaf704800 from 39 10000000:01000000:1.0:1787868612.934366:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787868612.934400:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.934419:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.934429:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868612.934450:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482496:0@lo:101: 00000100:00100000:1.0:1787868612.934809:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.934852:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.934906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482496 00000100:00100000:2.0:1787868612.934914:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482496 00000100:00100000:2.0:1787868612.937234:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787868612.937253:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939482496:12345-0@lo:101: 00010000:00010000:2.0:1787868612.937284:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868612.937304:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf58 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.937332:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.937344:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.937353:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871800, rc 0) 00000100:00100000:2.0:1787868612.937433:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939482496:12345-0@lo:101: Request processed in 186us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.937441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787868612.940075:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482496:0@lo:101: 00010000:00010000:2.0:1787868612.940103:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.940118:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.942549:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482624:0@lo:501: 00000100:00100000:2.0:1787868612.942704:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.942757:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.944052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482624 00000100:00100000:1.0:1787868612.944062:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482624 00000100:00100000:2.0:1787868612.944225:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787868612.944238:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939482624:12345-0@lo:501: 00000100:00100000:2.0:1787868612.944484:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939482624:12345-0@lo:501: Request processed in 248us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.944493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787868612.944904:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482624:0@lo:501: 00000100:00100000:0.0:1787868612.945036:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482752:0@lo:503: 00000100:00100000:0.0:1787868612.945093:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.945145:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868612.945250:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482752 00000100:00100000:3.0:1787868612.945257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482752 00000100:00100000:3.0:1787868612.945559:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787868612.945570:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939482752:12345-0@lo:503: 00000100:00100000:3.0:1787868612.945667:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939482752:12345-0@lo:503: Request processed in 99us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.945674:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787868612.945776:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939482752:0@lo:503: 00000100:00100000:1.0:1787868612.946105:0:9878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9878:1874715939482880:0@lo:502: 00000100:00100000:1.0:1787868612.946146:0:9878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.946325:0:9878:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.948216:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939482880 00000100:00100000:2.0:1787868612.948229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939482880 00000100:00100000:2.0:1787868612.948292:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787868612.948303:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:9878:x1874715939482880:12345-0@lo:502: 00000100:00100000:2.0:1787868612.951720:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:9878:x1874715939482880:12345-0@lo:502: Request processed in 3409us (5564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.951745:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787868612.951821:0:9878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9878:1874715939482880:0@lo:502: 00000100:00100000:1.0:1787868612.951890:0:9878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9878:1874715939483008:0@lo:502: 00000100:00100000:1.0:1787868612.951959:0:9878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.952000:0:9878:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.952843:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483008 00000100:00100000:2.0:1787868612.952853:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483008 00000100:00100000:2.0:1787868612.952897:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787868612.952907:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:9878:x1874715939483008:12345-0@lo:502: 00000100:00100000:2.0:1787868612.953040:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:9878:x1874715939483008:12345-0@lo:502: Request processed in 134us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.953053:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787868612.953087:0:9878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9878:1874715939483008:0@lo:502: 00000040:00080000:1.0:1787868612.953117:0:9878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787868612.953315:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787868612.953339:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868612.953350:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868612.953361:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868612.953371:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787868612.953373:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daaf704800 from 6 10000000:01000000:0.0:1787868612.953376:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787868612.953406:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868612.953414:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868612.953422:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868612.953439:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483136:0@lo:101: 00000100:00100000:0.0:1787868612.953544:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.953577:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.953819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483136 00000100:00100000:2.0:1787868612.953824:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483136 00000100:00100000:2.0:1787868612.953858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787868612.953867:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939483136:12345-0@lo:101: 00010000:00010000:2.0:1787868612.953876:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868612.953892:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2cf6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf66 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.953914:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2cf6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf66 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.953926:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2cf6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf66 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.953933:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870400, rc 0) 00000100:00100000:2.0:1787868612.953984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939483136:12345-0@lo:101: Request processed in 119us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.953990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787868612.954209:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483136:0@lo:101: 00010000:00010000:1.0:1787868612.954223:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.954233:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868612.954307:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483264:0@lo:256: 00000100:00100000:1.0:1787868612.954342:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.954366:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.954562:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483264 00000100:00100000:2.0:1787868612.954567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483264 00000100:00100000:2.0:1787868612.954605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787868612.954613:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939483264:12345-0@lo:256: 20000000:01000000:2.0:1787868612.954628:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787868612.954644:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787868612.954647:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787868612.955480:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939483264:12345-0@lo:256: Request processed in 866us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.955498:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787868612.955570:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483264:0@lo:256: 10000000:01000000:1.0:1787868612.955635:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787868612.955644:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.955654:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868612.955663:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787868612.955666:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787868612.955668:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787868612.955695:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.955703:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.955711:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868612.955726:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483392:0@lo:101: 00000100:00100000:1.0:1787868612.955762:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.955800:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.955827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483392 00000100:00100000:2.0:1787868612.955834:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483392 00000100:00100000:2.0:1787868612.955873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787868612.955882:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939483392:12345-0@lo:101: 00010000:00010000:2.0:1787868612.955892:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868612.955906:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf74 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.955926:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.955937:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.955945:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871e00, rc 0) 00000100:00100000:2.0:1787868612.955985:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939483392:12345-0@lo:101: Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.955993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787868612.957212:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483392:0@lo:101: 00010000:00010000:1.0:1787868612.957243:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.957254:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868612.957335:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483520:0@lo:501: 00000100:00100000:1.0:1787868612.957391:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.957436:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.957584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483520 00000100:00100000:2.0:1787868612.957599:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483520 00000100:00100000:2.0:1787868612.957643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868612.957653:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939483520:12345-0@lo:501: 00000100:00100000:2.0:1787868612.957794:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939483520:12345-0@lo:501: Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.957802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787868612.957916:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483520:0@lo:501: 00000100:00100000:1.0:1787868612.957956:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483648:0@lo:503: 00000100:00100000:1.0:1787868612.957996:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.958020:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.958280:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483648 00000100:00100000:2.0:1787868612.958285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483648 00000100:00100000:2.0:1787868612.958328:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787868612.958336:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939483648:12345-0@lo:503: 00000100:00100000:2.0:1787868612.958443:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939483648:12345-0@lo:503: Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.958452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787868612.958604:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939483648:0@lo:503: 00000100:00100000:1.0:1787868612.959106:0:9879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9879:1874715939483776:0@lo:502: 00000100:00100000:1.0:1787868612.959186:0:9879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.959208:0:9879:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.959257:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483776 00000100:00100000:0.0:1787868612.959272:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483776 00000100:00100000:0.0:1787868612.959311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787868612.959321:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9879:x1874715939483776:12345-0@lo:502: 00000100:00100000:0.0:1787868612.959422:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9879:x1874715939483776:12345-0@lo:502: Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.959435:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787868612.959885:0:9879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9879:1874715939483776:0@lo:502: 00000020:01000000:1.0:1787868612.959915:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787868612.959924:0:9879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787868612.959932:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868612.959934:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787868612.959940:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787868612.959943:0:9879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787868612.959967:0:9879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787868612.959971:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787868612.959992:0:9879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93d986e4ced8) 00000020:00000080:1.0:1787868612.960018:0:9879:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787868612.960025:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787868612.960111:0:9879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787868612.960118:0:9879:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787868612.960125:0:9879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2cf89 00010000:00080000:1.0:1787868612.960188:0:9879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab6f68800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868612.960436:0:9879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787868612.960785:0:9879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787868612.960801:0:9879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787868612.960994:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868612.961104:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868612.961278:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787868612.961367:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787868612.965820:0:9880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787868612.965827:0:9880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787868612.966972:0:9879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868612.966987:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787868612.967030:0:9879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787868612.967057:0:9879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2cf90 00000100:00080000:0.0:1787868612.967068:0:9879:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787868612.967074:0:9879:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab6f68800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868612.967110:0:9879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f97840 x1874715939483904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868612.967148:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939483904:0@lo:8: 00000100:00100000:0.0:1787868612.967583:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868612.967755:0:9879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787868612.967884:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939484032:0@lo:400: 00000100:00100000:0.0:1787868612.967921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.967946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939484544:0@lo:400: 00000100:00100000:0.0:1787868612.967969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.967991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787868612.967997:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939484160:0@lo:400: 00000100:00100000:0.0:1787868612.968018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.968037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939484672:0@lo:400: 00000100:00100000:0.0:1787868612.968057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.968079:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939484288:0@lo:400: 00000100:00100000:0.0:1787868612.968108:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.968127:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939484800:0@lo:400: 00000100:00100000:0.0:1787868612.968151:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.968194:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868612.968199:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939484416:0@lo:400: 00000100:00100000:0.0:1787868612.968223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.968250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484032 00000100:00100000:0.0:1787868612.968257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484032 00000100:00100000:0.0:1787868612.968311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484544 00000100:00100000:0.0:1787868612.968314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484544 00000100:00100000:0.0:1787868612.968338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484160 00000100:00100000:0.0:1787868612.968341:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484160 00000100:00100000:0.0:1787868612.968366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484672 00000100:00100000:0.0:1787868612.968369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484672 00000100:00100000:0.0:1787868612.968384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484800 00000100:00100000:0.0:1787868612.968387:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484800 00000100:00100000:0.0:1787868612.968398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484416 00000100:00100000:0.0:1787868612.968405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484416 00000100:00100000:0.0:1787868612.968422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868612.968430:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939484032:12345-0@lo:400: 00000100:00100000:2.0:1787868612.968671:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939483904 00000100:00100000:2.0:1787868612.968677:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939483904 00000100:00100000:2.0:1787868612.968710:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868612.968716:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3635:x1874715939483904:12345-0@lo:8: 00010000:00080000:2.0:1787868612.968743:0:8962:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787868612.968776:0:8962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2cf97 00002000:00100000:2.0:1787868612.968792:0:8962:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93dab7ec8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787868612.968796:0:8962:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787868612.968801:0:8962:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787868612.968869:0:8962:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787868612.969238:0:8962:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787868612.969277:0:8962:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868612.969339:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939483904:12345-0@lo:8: Request processed in 621us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.969347:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787868612.969659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939484032:12345-0@lo:400: Request processed in 1228us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.969667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868612.969689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868612.969697:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939484544:12345-0@lo:400: 00000100:00100000:0.0:1787868612.969729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939484544:12345-0@lo:400: Request processed in 33us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.969735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868612.969747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868612.969753:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939484160:12345-0@lo:400: 00000100:00100000:0.0:1787868612.969779:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939484160:12345-0@lo:400: Request processed in 27us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.969795:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868612.969806:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868612.969812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939484672:12345-0@lo:400: 00010000:00080000:1.0:1787868612.969825:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f97840 x1874715939483904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868612.969837:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1787868612.969838:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939484672:12345-0@lo:400: Request processed in 27us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.969842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787868612.969845:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787868612.969852:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1787868612.969852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787868612.969857:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:0.0:1787868612.969858:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939484800:12345-0@lo:400: 00000100:00080000:1.0:1787868612.969859:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787868612.969870:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787868612.969875:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939483904:0@lo:8: 00000100:00100000:0.0:1787868612.969887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939484800:12345-0@lo:400: Request processed in 31us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.969893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:1.0:1787868612.969903:0:9880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787868612.969904:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787868612.969910:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939484416:12345-0@lo:400: 00000004:00080000:1.0:1787868612.969956:0:9880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 237095799415ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787868612.969962:0:9880:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1787868612.970063:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da98b82580 x1874715939484160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868612.970074:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939484160:0@lo:400: 00010000:00080000:2.0:1787868612.970083:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd852d00 x1874715939484672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868612.970090:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939484672:0@lo:400: 00010000:00080000:2.0:1787868612.970111:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f94f00 x1874715939484032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868612.970118:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939484032:0@lo:400: 00010000:00080000:2.0:1787868612.970128:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd851a40 x1874715939484544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868612.970135:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939484544:0@lo:400: 00000100:00100000:2.0:1787868612.970209:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939484928:0@lo:700: 00000100:00100000:2.0:1787868612.970245:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.970287:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986c0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.970365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939484416:12345-0@lo:400: Request processed in 455us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.970739:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787868612.970780:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484288 00000100:00100000:0.0:1787868612.970786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484288 00000100:00100000:0.0:1787868612.970862:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787868612.970870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939484288:12345-0@lo:400: 00000100:00100000:0.0:1787868612.970910:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939484288:12345-0@lo:400: Request processed in 41us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.970916:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787868612.971091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868612.971096:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787868612.971121:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd8530c0 x1874715939484416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868612.971142:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939484416:0@lo:400: 00000100:00100000:2.0:1787868612.971218:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939484928 00000100:00100000:2.0:1787868612.971223:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939484928 00000100:00100000:2.0:1787868612.971272:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868612.971280:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9882:x1874715939484928:12345-0@lo:700: 00000100:00100000:2.0:1787868612.971313:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1874715939485056:0@lo:700: 00000100:00100000:2.0:1787868612.971342:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.971360:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.971462:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939484288:0@lo:400: 00010000:00080000:0.0:1787868612.971550:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd853c00 x1874715939484800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868612.971560:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939484800:0@lo:400: 00000100:00100000:0.0:1787868612.971588:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485056 00000100:00100000:0.0:1787868612.971592:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485056 00000100:00100000:0.0:1787868612.971622:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787868612.971628:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1874715939485056:12345-0@lo:700: 00000100:00080000:0.0:1787868612.971732:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:0.0:1787868612.971800:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868612.971806:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868612.971807:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787868612.971810:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868612.971815:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868612.971816:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787868612.971819:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787868612.971821:0:9879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787868612.971842:0:9879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9879:1874715939485184:0@lo:502: 00000100:00100000:0.0:1787868612.971886:0:9879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.971909:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485184 00000100:00100000:0.0:1787868612.971912:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485184 00000100:00100000:0.0:1787868612.972193:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787868612.972201:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:9879:x1874715939485184:12345-0@lo:502: 00000100:00100000:0.0:1787868612.972310:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:9879:x1874715939485184:12345-0@lo:502: Request processed in 109us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.972326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787868612.972415:0:9879:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.972430:0:9879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9879:1874715939485184:0@lo:502: 00000020:01000000:0.0:1787868612.972450:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868612.972455:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868612.972456:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787868612.972459:0:9879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787868612.972631:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787868612.972650:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787868612.972660:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.972671:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868612.972682:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787868612.972685:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05d8800 from 39 10000000:01000000:2.0:1787868612.972695:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787868612.972722:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.972731:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.972739:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.972753:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485312:0@lo:101: 00000100:00100000:2.0:1787868612.972787:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.972817:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.973180:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485312 00000100:00100000:1.0:1787868612.973185:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485312 00000100:00100000:1.0:1787868612.973223:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787868612.973231:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939485312:12345-0@lo:101: 00010000:00010000:1.0:1787868612.973239:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868612.973252:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cf9e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.973284:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.973295:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868612.973304:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b400, rc 0) 00000100:00100000:1.0:1787868612.973345:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485312:12345-0@lo:101: Request processed in 116us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868612.973362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787868612.973393:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485312:0@lo:101: 00010000:00010000:2.0:1787868612.973407:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.973417:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.973469:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485440:0@lo:501: 00000100:00100000:2.0:1787868612.973496:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.973567:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868612.973710:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485440 00000100:00100000:0.0:1787868612.973714:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485440 00000100:00100000:0.0:1787868612.973787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787868612.973795:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485440:12345-0@lo:501: 00000100:00100000:0.0:1787868612.973907:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485440:12345-0@lo:501: Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868612.973915:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787868612.974085:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485440:0@lo:501: 00000100:00100000:0.0:1787868612.974119:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485568:0@lo:503: 00000100:00100000:0.0:1787868612.974225:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868612.974286:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868612.975808:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485568 00000100:00100000:1.0:1787868612.975819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485568 00000100:00100000:1.0:1787868612.982196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787868612.982223:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485568:12345-0@lo:503: 00000100:00100000:1.0:1787868612.984925:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485568:12345-0@lo:503: Request processed in 2702us (10690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868612.984940:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:1.0:1787868612.985994:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787868612.987608:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485568:0@lo:503: 00000100:00100000:1.0:1787868612.988081:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9884:1874715939485696:0@lo:502: 00000100:00100000:1.0:1787868612.988177:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868612.988209:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93900000 going to sleep for 11 seconds 40000000:02000000:1.0:1787868612.989510:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787868612.991455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485696 00000100:00100000:2.0:1787868612.991478:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485696 00000100:00100000:3.0:1787868612.991664:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787868612.991675:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9884:x1874715939485696:12345-0@lo:502: 00000100:00100000:3.0:1787868612.991852:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9884:x1874715939485696:12345-0@lo:502: Request processed in 178us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.991860:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787868612.991916:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9884:1874715939485696:0@lo:502: 00000100:00100000:3.0:1787868612.991981:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9884:1874715939485824:0@lo:502: 00000100:00100000:3.0:1787868612.992023:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.992062:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485824 00000100:00100000:3.0:1787868612.992065:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485824 00000100:00100000:3.0:1787868612.992096:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787868612.992104:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9884:x1874715939485824:12345-0@lo:502: 00000100:00100000:3.0:1787868612.992325:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:9884:x1874715939485824:12345-0@lo:502: Request processed in 221us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.992332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787868612.992529:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae692540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868612.992542:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9884:1874715939485824:0@lo:502: 00000040:00080000:3.0:1787868612.992560:0:9884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787868612.992645:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787868612.992673:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787868612.992686:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.992709:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868612.992718:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787868612.992720:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05d8800 from 6 10000000:01000000:2.0:1787868612.992723:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868612.992749:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.992757:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.992765:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868612.992778:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485952:0@lo:101: 00000100:00100000:2.0:1787868612.992811:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.992836:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868612.992943:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939485952 00000100:00100000:3.0:1787868612.992948:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939485952 00000100:00100000:3.0:1787868612.992980:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787868612.992989:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939485952:12345-0@lo:101: 00010000:00010000:3.0:1787868612.992997:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868612.993010:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2cfb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cfac expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.993031:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2cfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfac expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.993041:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2cfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfac expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.993050:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030e00, rc 0) 00000100:00100000:3.0:1787868612.993078:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939485952:12345-0@lo:101: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.993084:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787868612.993309:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939485952:0@lo:101: 00010000:00010000:2.0:1787868612.993322:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.993331:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868612.994822:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486080:0@lo:256: 00000100:00100000:3.0:1787868612.994886:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.994930:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae692cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.995662:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486080 00000100:00100000:2.0:1787868612.995670:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486080 00000100:00100000:2.0:1787868612.995712:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787868612.995732:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939486080:12345-0@lo:256: 20000000:01000000:2.0:1787868612.995755:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787868612.995772:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787868612.995774:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787868612.995900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939486080:12345-0@lo:256: Request processed in 171us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.995907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787868612.995939:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486080:0@lo:256: 10000000:01000000:3.0:1787868612.995992:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868612.996010:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.996021:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868612.996030:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787868612.996032:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787868612.996035:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787868612.996060:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.996068:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.996076:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868612.996088:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486208:0@lo:101: 00000100:00100000:3.0:1787868612.996113:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.996149:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae692cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.996190:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486208 00000100:00100000:2.0:1787868612.996195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486208 00000100:00100000:2.0:1787868612.996225:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787868612.996232:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939486208:12345-0@lo:101: 00010000:00010000:2.0:1787868612.996241:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868612.996253:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cfba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.996287:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.996297:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868612.996306:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871600, rc 0) 00000100:00100000:2.0:1787868612.996348:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486208:12345-0@lo:101: Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.996400:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486208:0@lo:101: 00010000:00010000:3.0:1787868612.996411:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868612.996429:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868612.996480:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486336:0@lo:501: 00000100:00100000:3.0:1787868612.996505:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.996522:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae692cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.997680:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787868612.997728:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486336 00000100:00100000:2.0:1787868612.997733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486336 00000100:00100000:2.0:1787868612.997775:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787868612.997784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486336:12345-0@lo:501: 00000100:00100000:2.0:1787868612.997959:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486336:12345-0@lo:501: Request processed in 176us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868612.997966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787868612.998220:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486336:0@lo:501: 00000100:00100000:3.0:1787868612.998271:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486464:0@lo:503: 00000100:00100000:3.0:1787868612.998339:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868612.998369:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae692cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868612.998674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486464 00000100:00100000:2.0:1787868612.998679:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486464 00000100:00100000:2.0:1787868612.998716:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787868612.998724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486464:12345-0@lo:503: 00000100:00100000:2.0:1787868612.998819:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486464:12345-0@lo:503: Request processed in 96us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868612.998826:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486464:0@lo:503: 00000100:00100000:2.0:1787868612.998827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787868612.999799:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9885:1874715939486592:0@lo:502: 00000100:00100000:2.0:1787868612.999851:0:9885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868612.999888:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787868613.000204:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486592 00000100:00100000:3.0:1787868613.000210:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486592 00000100:00100000:3.0:1787868613.000247:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787868613.000255:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:9885:x1874715939486592:12345-0@lo:502: 00000100:00100000:3.0:1787868613.000402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:9885:x1874715939486592:12345-0@lo:502: Request processed in 148us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868613.000409:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787868613.000627:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9885:1874715939486592:0@lo:502: 00000020:01000000:0.0:1787868613.000656:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787868613.000664:0:9885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787868613.000671:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868613.000673:0:9885:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787868613.000679:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787868613.000682:0:9885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1787868613.000705:0:9885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787868613.000713:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868613.000729:0:9885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d9863d0000) 00000020:00000080:0.0:1787868613.000750:0:9885:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787868613.000755:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787868613.000834:0:9885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787868613.000840:0:9885:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787868613.000847:0:9885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2cfcf 00010000:00080000:0.0:1787868613.000877:0:9885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dabec45800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787868613.001115:0:9885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1787868613.001274:0:9885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787868613.001286:0:9885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787868613.001450:0:9885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868613.001583:0:9885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868613.001739:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787868613.001827:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00080000:3.0:1787868613.003530:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a580 x1874715939485056/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787868628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868613.003548:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1874715939485056:0@lo:700: 40000000:02000000:3.0:1787868613.003561:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1787868613.003922:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1874715939485056:12345-0@lo:700: Request processed in 31825us (32110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868613.003936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787868613.006109:0:9887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787868613.006118:0:9887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787868613.011636:0:9885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787868613.011654:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787868613.011722:0:9885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787868613.011752:0:9885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2cfd6 00000100:00080000:2.0:1787868613.011764:0:9885:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868613.011770:0:9885:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dabec45800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868613.011811:0:9885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed0b480 x1874715939486720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868613.011841:0:9885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787868613.011901:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868613.011905:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868613.011907:0:9885:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787868613.011917:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868613.011934:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868613.011936:0:9885:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787868613.011939:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787868613.011941:0:9885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787868613.011969:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9885:1874715939486848:0@lo:502: 00000100:00100000:2.0:1787868613.012042:0:9885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.012077:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868613.012096:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486848 00000100:00100000:2.0:1787868613.012102:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486848 00000100:00100000:2.0:1787868613.012142:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787868613.012151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:9885:x1874715939486848:12345-0@lo:502: 00000100:00100000:2.0:1787868613.012304:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:9885:x1874715939486848:12345-0@lo:502: Request processed in 154us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.012312:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787868613.012362:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:9885:1874715939486848:0@lo:502: 00000020:01000000:2.0:1787868613.012382:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868613.012386:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868613.012388:0:9885:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787868613.012391:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1787868613.012611:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939486720:0@lo:8: 00000100:00100000:1.0:1787868613.012649:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787868613.012961:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787868613.012982:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787868613.012997:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868613.013006:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868613.013015:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787868613.013018:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93daae688000 from 1 10000000:01000000:3.0:1787868613.013020:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787868613.013045:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868613.013052:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868613.013061:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868613.013074:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486976:0@lo:101: 00000100:00100000:3.0:1787868613.013104:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868613.013130:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae6929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868613.013241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486976 00000100:00100000:1.0:1787868613.013246:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486976 00000100:00100000:1.0:1787868613.013290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787868613.013299:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939486976:12345-0@lo:101: 00010000:00010000:1.0:1787868613.013310:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868613.013324:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2cfdd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868613.013346:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868613.013357:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868613.013366:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a800, rc 0) 00000100:00100000:1.0:1787868613.013398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939486976:12345-0@lo:101: Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868613.013403:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787868613.013525:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939486720 00000100:00100000:2.0:1787868613.013530:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939486720 00000100:00100000:2.0:1787868613.013560:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868613.013566:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939486720:12345-0@lo:8: 00010000:00080000:2.0:1787868613.013590:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787868613.013615:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2cfeb 00002000:00100000:2.0:1787868613.013629:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93dabec6d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787868613.013633:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787868613.013643:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787868613.013895:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939486976:0@lo:101: 00010000:00010000:3.0:1787868613.013910:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868613.013918:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868613.013969:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939487104:0@lo:501: 00000100:00100000:3.0:1787868613.014009:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868613.014030:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae6929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868613.014042:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487104 00000100:00100000:3.0:1787868613.014045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487104 00000100:00100000:3.0:1787868613.014070:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787868613.014077:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939487104:12345-0@lo:501: 00000100:00100000:3.0:1787868613.014145:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939487104:12345-0@lo:501: Request processed in 68us (135us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787868613.014152:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787868613.014183:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939487104:0@lo:501: 10000000:01000000:1.0:1787868613.014204:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787868613.014209:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868613.014227:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787868613.015614:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787868613.015649:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93dabec6b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868613.015726:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939486720:12345-0@lo:8: Request processed in 2158us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.015735:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787868613.016178:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0b480 x1874715939486720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868613.016190:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868613.016197:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787868613.016206:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787868613.016211:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787868613.016213:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec45800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787868613.016235:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787868613.016241:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939486720:0@lo:8: 00000004:00080000:3.0:1787868613.016860:0:9887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787868613.016917:0:9887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237142760810ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787868613.016923:0:9887:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:1.0:1787868613.023287:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787868613.023623:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939484928:12345-0@lo:700: Request processed in 52338us (53370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.023636:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787868613.023766:0:9882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a940 x1874715939484928/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787868628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868613.023782:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939484928:0@lo:700: 00000004:00080000:2.0:1787868613.026369:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787868613.026477:0:9888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787868613.026508:0:9888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487360:0@lo:7: 00000100:00100000:2.0:1787868613.026582:0:9888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.026623:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487360 00000100:00100000:2.0:1787868613.026629:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487360 00000100:00100000:2.0:1787868613.026683:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868613.026692:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9888:x1874715939487360:12345-0@lo:7: 00000100:00100000:0.0:1787868613.029209:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868613.029234:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939487232:0@lo:13: 00000100:00100000:0.0:1787868613.029314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868613.029365:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868613.029379:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487232 00000100:00100000:0.0:1787868613.029386:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487232 00000100:00100000:0.0:1787868613.029427:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787868613.029436:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874715939487232:12345-0@lo:13: 00002000:00000024:0.0:1787868613.029463:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923849216 avail 3692326912 00000100:00100000:0.0:1787868613.029508:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874715939487232:12345-0@lo:13: Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868613.029515:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787868613.029572:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed09680 x1874715939487232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868613.029591:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939487232:0@lo:13: 00000100:00100000:0.0:1787868613.030306:0:9888:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1240 going to sleep for 11 seconds 00002000:00080000:2.0:1787868613.031746:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787868613.031753:0:8429:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787868613.032435:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9888:x1874715939487360:12345-0@lo:7: Request processed in 5739us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.032447:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787868613.032529:0:9888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a940 x1874715939487360/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868613.032543:0:9888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487360:0@lo:7: 00000004:00080000:0.0:1787868613.032556:0:9888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787868613.032591:0:9888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487488:0@lo:5: 00000100:00100000:0.0:1787868613.032625:0:9888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868613.032651:0:9888:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787868613.032702:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487488 00000100:00100000:1.0:1787868613.032709:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487488 00000100:00100000:1.0:1787868613.032753:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868613.032763:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd853840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9888:x1874715939487488:12345-0@lo:5: 00002000:00080000:1.0:1787868613.032787:0:8431:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787868613.032791:0:8431:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1787868613.040174:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787868613.040191:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787868613.040350:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd853840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9888:x1874715939487488:12345-0@lo:5: Request processed in 7583us (7718us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787868613.040360:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787868613.040507:0:9888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd852940 x1874715939487488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868613.040520:0:9888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787868613.040527:0:9888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487488:0@lo:5: 00000004:00080000:0.0:1787868613.040543:0:9888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787868613.040589:0:9888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487616:0@lo:700: 00000100:00100000:0.0:1787868613.040626:0:9888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868613.040658:0:9888:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787868613.040735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487616 00000100:00100000:3.0:1787868613.040742:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487616 00000100:00100000:3.0:1787868613.040792:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868613.040802:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9888:x1874715939487616:12345-0@lo:700: 00000004:00080000:1.0:1787868613.045331:0:9882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787868613.045364:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939487744:0@lo:13: 00000100:00100000:1.0:1787868613.045368:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939487872:0@lo:7: 00000100:00100000:1.0:1787868613.050451:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868613.050525:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93900f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868613.050593:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487872 00000100:00100000:2.0:1787868613.050602:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487872 00000100:00100000:2.0:1787868613.050661:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868613.050671:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939487872:12345-0@lo:7: 00000100:00100000:3.0:1787868613.052011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868613.052076:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939487744 00000100:00100000:3.0:1787868613.052082:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939487744 00000100:00100000:3.0:1787868613.052121:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868613.052129:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939487744:12345-0@lo:13: 00002000:00000024:3.0:1787868613.052187:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923849216 avail 3692326912 00000100:00100000:3.0:1787868613.052235:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939487744:12345-0@lo:13: Request processed in 107us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868613.052243:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787868613.052300:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98824f480 x1874715939487744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868613.052320:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939487744:0@lo:13: 00002000:00080000:2.0:1787868613.058899:0:8962:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787868613.058908:0:8962:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787868613.059009:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939487872:12345-0@lo:7: Request processed in 8336us (8565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.059022:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787868613.059229:0:9882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98824d680 x1874715939487872/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868613.059243:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939487872:0@lo:7: 00000100:00100000:3.0:1787868613.068733:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9888:x1874715939487616:12345-0@lo:700: Request processed in 27922us (28096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868613.068749:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1787868613.069126:0:9882:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787868613.069405:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939488000:0@lo:5: 00000100:00100000:2.0:1787868613.069456:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.069494:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488000 00000100:00100000:2.0:1787868613.069502:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488000 00000100:00100000:2.0:1787868613.069546:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868613.069556:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939488000:12345-0@lo:5: 00002000:00080000:2.0:1787868613.069583:0:8430:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787868613.069615:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939488000:12345-0@lo:5: Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.069622:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868613.069650:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154db40 going to sleep for 11 seconds 00010000:00080000:2.0:1787868613.069674:0:9882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a580 x1874715939488000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868613.069686:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939488000:0@lo:5: 00000004:00080000:2.0:1787868613.069697:0:9882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787868613.069722:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939488128:0@lo:5: 00000100:00100000:2.0:1787868613.069744:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.069766:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488128 00000100:00100000:2.0:1787868613.069769:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488128 00000100:00100000:2.0:1787868613.069801:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787868613.069807:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9882:x1874715939488128:12345-0@lo:5: 00002000:00080000:2.0:1787868613.069832:0:8429:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00080000:0.0:1787868613.071212:0:9888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd852940 x1874715939487616/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868613.071230:0:9888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939487616:0@lo:700: 00000100:00100000:2.0:1787868613.071466:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9882:x1874715939488128:12345-0@lo:5: Request processed in 1658us (1720us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787868613.071475:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787868613.071545:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154db40 going to sleep for 11 seconds 00010000:00080000:2.0:1787868613.071561:0:9882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a580 x1874715939488128/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868613.071574:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9882:1874715939488128:0@lo:5: 00000004:00080000:2.0:1787868613.071584:0:9882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787868613.071628:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9882:1874715939488256:0@lo:900: 00000100:00100000:2.0:1787868613.071660:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.071692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488256 00000100:00100000:2.0:1787868613.071697:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488256 00000100:00100000:2.0:1787868613.071731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868613.071739:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9882:x1874715939488256:12345-0@lo:900: 00000100:00100000:2.0:1787868613.071776:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9882:x1874715939488256:12345-0@lo:900: Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868613.071782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868613.071796:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943900 going to sleep for 11 seconds 00010000:00080000:2.0:1787868613.071808:0:9882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a940 x1874715939488256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868613.071817:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9882:1874715939488256:0@lo:900: 00000004:02000040:0.0:1787868613.083665:0:9888:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787868613.102274:0:9888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939488384:0@lo:5: 00000100:00100000:2.0:1787868613.102376:0:9888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868613.102446:0:9888:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93943900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868613.102529:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488384 00000100:00100000:0.0:1787868613.102538:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488384 00000100:00100000:0.0:1787868613.102603:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787868613.102613:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9888:x1874715939488384:12345-0@lo:5: 00002000:00080000:2.0:1787868613.110712:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787868613.110734:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787868613.115641:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9888:x1874715939488384:12345-0@lo:5: Request processed in 13022us (13257us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787868613.115655:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787868613.117357:0:9888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0a940 x1874715939488384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868629 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868613.117377:0:9888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9888:1874715939488384:0@lo:5: 00000004:00080000:3.0:1787868613.117391:0:9888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1787868613.413544:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939488512:0@lo:41: 00000100:00100000:2.0:1787868613.413665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868613.413858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488512 00000100:00100000:1.0:1787868613.413871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488512 00000100:00100000:1.0:1787868613.413943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868613.413955:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939488512:12345-0@lo:41: 00000004:00000024:1.0:1787868613.414001:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868613.414058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939488512:12345-0@lo:41: Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868613.414066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787868613.414342:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939488512:0@lo:41: 00010000:00010000:1.0:1787868613.736040:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787868613.790465:0:9930:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787868613.791350:0:9930:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868614.753544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787868614.891832:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1787868614.891851:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787868615.777904:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868616.806234:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868617.317805:0:10032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868617.318037:0:10032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868617.828234:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868618.017341:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939488640:0@lo:13: 00000100:00100000:2.0:1787868618.017416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.017563:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488640 00000100:00100000:3.0:1787868618.017571:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488640 00000100:00100000:3.0:1787868618.017640:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868618.017651:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939488640:12345-0@lo:13: 00002000:00000024:3.0:1787868618.017680:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868618.017732:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939488640:12345-0@lo:13: Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.017745:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787868618.017766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868618.017798:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e99680 x1874715939488640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.017816:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939488640:0@lo:13: 00000100:00100000:3.0:1787868618.017836:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868618.017842:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939488768:0@lo:41: 00000100:00100000:3.0:1787868618.017884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.017916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488768 00000100:00100000:3.0:1787868618.017920:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488768 00000100:00100000:3.0:1787868618.017949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787868618.017955:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939488768:12345-0@lo:41: 00000004:00000024:3.0:1787868618.017980:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787868618.018015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939488768:12345-0@lo:41: Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.018022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787868618.018051:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939488768:0@lo:41: 00000100:00100000:3.0:1787868618.018274:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939488896:0@lo:13: 00000100:00100000:3.0:1787868618.018302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.018332:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939488896 00000100:00100000:3.0:1787868618.018336:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939488896 00000100:00100000:3.0:1787868618.018364:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787868618.018371:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939488896:12345-0@lo:13: 00002000:00000024:3.0:1787868618.018382:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868618.018410:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939488896:12345-0@lo:13: Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.018424:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787868618.018441:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868618.018459:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7009a40 x1874715939488896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.018471:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939488896:0@lo:13: 00000100:00100000:3.0:1787868618.021459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939489408:0@lo:400: 00000100:00100000:3.0:1787868618.021525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.021556:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939489920:0@lo:400: 00000100:00100000:3.0:1787868618.021579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.021616:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787868618.021621:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939489024:0@lo:400: 00000100:00100000:3.0:1787868618.021646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.021669:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939489536:0@lo:400: 00000100:00100000:3.0:1787868618.021687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.021713:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939490048:0@lo:400: 00000100:00100000:3.0:1787868618.021735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.021759:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489408 00000100:00100000:3.0:1787868618.021765:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489408 00000100:00100000:3.0:1787868618.021806:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787868618.021814:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939489408:12345-0@lo:400: 00000100:00100000:3.0:1787868618.021862:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939489408:12345-0@lo:400: Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.021869:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787868618.021890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489920 00000100:00100000:3.0:1787868618.021893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489920 00000100:00100000:3.0:1787868618.021935:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489536 00000100:00100000:3.0:1787868618.021937:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489536 00000100:00100000:3.0:1787868618.021951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868618.021957:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939489920:12345-0@lo:400: 00000100:00100000:3.0:1787868618.021983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939489920:12345-0@lo:400: Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.021988:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868618.021998:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868618.022003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939489536:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022023:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939489536:12345-0@lo:400: Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868618.022043:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489024 00000100:00100000:3.0:1787868618.022046:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489024 00000100:00100000:3.0:1787868618.022067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787868618.022073:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939489024:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939489024:12345-0@lo:400: Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022103:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1787868618.022133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868618.022136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868618.022147:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939489152:0@lo:400: 00000100:00100000:3.0:1787868618.022201:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.022216:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939489664:0@lo:400: 00000100:00100000:3.0:1787868618.022234:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.022245:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939490176:0@lo:400: 00000100:00100000:3.0:1787868618.022276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.022297:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787868618.022303:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939489280:0@lo:400: 00000100:00100000:3.0:1787868618.022324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.022338:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939489792:0@lo:400: 00000100:00100000:3.0:1787868618.022356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.022376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489152 00000100:00100000:3.0:1787868618.022379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489152 00000100:00100000:3.0:1787868618.022396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489664 00000100:00100000:3.0:1787868618.022398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489664 00000100:00100000:3.0:1787868618.022415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489280 00000100:00100000:3.0:1787868618.022418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489280 00000100:00100000:3.0:1787868618.022429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939489792 00000100:00100000:3.0:1787868618.022431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939489792 00000100:00100000:3.0:1787868618.022445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868618.022450:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939489152:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939489152:12345-0@lo:400: Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868618.022497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787868618.022502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939489664:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939489664:12345-0@lo:400: Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787868618.022542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787868618.022547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939489280:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939489280:12345-0@lo:400: Request processed in 20us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787868618.022588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787868618.022594:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939489792:12345-0@lo:400: 00000100:00100000:3.0:1787868618.022619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939489792:12345-0@lo:400: Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.022625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787868618.022638:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868618.022641:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868618.022666:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939489024:0@lo:400: 00010000:00080000:3.0:1787868618.022680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700a580 x1874715939489536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022706:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939489536:0@lo:400: 00000100:00100000:3.0:1787868618.022718:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939489408:0@lo:400: 00010000:00080000:3.0:1787868618.022728:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008000 x1874715939489920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022735:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939489920:0@lo:400: 00010000:00080000:3.0:1787868618.022762:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008f00 x1874715939489280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022772:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939489280:0@lo:400: 00010000:00080000:3.0:1787868618.022781:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7009e00 x1874715939489792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022789:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939489792:0@lo:400: 00010000:00080000:3.0:1787868618.022798:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700bc00 x1874715939489152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022818:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939489152:0@lo:400: 00010000:00080000:3.0:1787868618.022829:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008b40 x1874715939489664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868618.022836:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939489664:0@lo:400: 00000100:00100000:2.0:1787868618.023138:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490048 00000100:00100000:2.0:1787868618.023143:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490048 00000100:00100000:2.0:1787868618.023209:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490176 00000100:00100000:2.0:1787868618.023212:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490176 00000100:00100000:2.0:1787868618.023232:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868618.023239:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939490048:12345-0@lo:400: 00000100:00100000:2.0:1787868618.023286:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939490048:12345-0@lo:400: Request processed in 47us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868618.023292:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868618.023305:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868618.023311:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939490176:12345-0@lo:400: 00000100:00100000:2.0:1787868618.023344:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939490176:12345-0@lo:400: Request processed in 34us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868618.023350:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787868618.023391:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787868618.023411:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939490048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868618.023420:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787868618.023433:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939490048:0@lo:400: 00010000:00080000:2.0:1787868618.023456:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700a940 x1874715939490176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868618.023464:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787868618.023472:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939490176:0@lo:400: 00000020:00000004:3.0:1787868618.265485:0:10080:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787868618.265497:0:10080:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1787868618.530418:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939490304:0@lo:41: 00000100:00100000:0.0:1787868618.530493:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868618.530957:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939490432:0@lo:13: 00000100:00100000:1.0:1787868618.530993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868618.531042:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490432 00000100:00100000:1.0:1787868618.531052:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490432 00000100:00100000:1.0:1787868618.531102:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868618.531113:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939490432:12345-0@lo:13: 00002000:00000024:1.0:1787868618.531143:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868618.531217:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939490432:12345-0@lo:13: Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868618.531224:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868618.532123:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490304 00000100:00100000:3.0:1787868618.532131:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490304 00000100:00100000:3.0:1787868618.532191:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787868618.532200:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939490304:12345-0@lo:41: 00000004:00000024:3.0:1787868618.532229:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00010000:00080000:1.0:1787868618.532699:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98824da40 x1874715939490432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868618.532720:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939490432:0@lo:13: 00000100:00100000:1.0:1787868618.532741:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868618.532750:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939490560:0@lo:13: 00000100:00100000:1.0:1787868618.532809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868618.534021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939490304:12345-0@lo:41: Request processed in 1817us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868618.534033:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868618.534389:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939490304:0@lo:41: 00000100:00100000:0.0:1787868618.534418:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490560 00000100:00100000:0.0:1787868618.534423:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490560 00000100:00100000:0.0:1787868618.534463:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787868618.534471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939490560:12345-0@lo:13: 00002000:00000024:0.0:1787868618.534492:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868618.534535:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939490560:12345-0@lo:13: Request processed in 65us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868618.534541:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787868618.534571:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd8503c0 x1874715939490560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868618.534585:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939490560:0@lo:13: 00010000:00010000:1.0:1787868618.849613:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868619.874059:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868619.999926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868620.000245:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467456 00000100:00100000:1.0:1787868620.000257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467456 00000100:00100000:1.0:1787868620.000301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:1.0:1787868620.000309:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1874715918467456:12345-192.168.204.27@tcp:250: 00010000:00080000:1.0:1787868620.000339:0:6507:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from fecd04dc-e32d-4648-8add-7b218bbcda4e@192.168.204.27@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787868620.000381:0:6507:0:(genops.c:1385:class_connect()) connect: client fecd04dc-e32d-4648-8add-7b218bbcda4e, cookie 0x2f11f4d3bde2cff2 00000100:00080000:1.0:1787868620.000525:0:6507:0:(import.c:65:import_set_state_nolock()) ffff93dab6f6d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868620.000654:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+5:2402:x1874715918467456:12345-192.168.204.27@tcp:250: Request processed in 344us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868620.000662:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:1.0:1787868620.018057:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.023089:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467328 00000100:00100000:3.0:1787868620.023105:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467328 00000100:00100000:1.0:1787868620.023381:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:1.0:1787868620.023395:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+5:6165:x1874715918467328:12345-192.168.204.27@tcp:101: 00010000:00010000:1.0:1787868620.023413:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868620.023435:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868620.023478:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868620.023490:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868620.023500:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a000, rc 0) 00000100:00100000:1.0:1787868620.023581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+6:6165:x1874715918467328:12345-192.168.204.27@tcp:101: Request processed in 189us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868620.023603:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:0.0:1787868620.027313:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.027419:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467584 00000100:00100000:3.0:1787868620.027429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467584 00000100:00100000:3.0:1787868620.027485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:3.0:1787868620.027496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+6:6165:x1874715918467584:12345-192.168.204.27@tcp:501: 00000100:00100000:3.0:1787868620.027768:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+6:6165:x1874715918467584:12345-192.168.204.27@tcp:501: Request processed in 272us (464us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787868620.027786:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:0.0:1787868620.037359:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.037776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467712 00000100:00100000:2.0:1787868620.037788:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467712 00000100:00100000:2.0:1787868620.037846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:2.0:1787868620.037856:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+6:6165:x1874715918467712:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1787868620.037872:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868620.037892:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.037921:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.037932:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.037941:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870800, rc 0) 00000100:00100000:2.0:1787868620.038000:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+7:6165:x1874715918467712:12345-192.168.204.27@tcp:101: Request processed in 145us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.038023:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:0.0:1787868620.043582:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868620.043736:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467840 00000100:00100000:1.0:1787868620.043746:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467840 00000100:00100000:1.0:1787868620.043804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1787868620.043815:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+7:6165:x1874715918467840:12345-192.168.204.27@tcp:501: 00000100:00100000:1.0:1787868620.043985:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6165:x1874715918467840:12345-192.168.204.27@tcp:501: Request processed in 171us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868620.043993:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:0.0:1787868620.053774:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.053973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918467968 00000100:00100000:3.0:1787868620.053997:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918467968 00000100:00100000:2.0:1787868620.054356:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:2.0:1787868620.054372:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6165:x1874715918467968:12345-192.168.204.27@tcp:503: 00000100:00100000:2.0:1787868620.054596:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6165:x1874715918467968:12345-192.168.204.27@tcp:503: Request processed in 227us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.054605:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:1.0:1787868620.059502:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.059683:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468096 00000100:00100000:2.0:1787868620.059692:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468096 00000100:00100000:2.0:1787868620.059774:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:2.0:1787868620.059785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6184:x1874715918468096:12345-192.168.204.27@tcp:502: 00000100:00100000:2.0:1787868620.059962:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6184:x1874715918468096:12345-192.168.204.27@tcp:502: Request processed in 179us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.059971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1787868620.146502:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.146897:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468224 00000100:00100000:2.0:1787868620.146908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468224 00000100:00100000:2.0:1787868620.146976:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:2.0:1787868620.146987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6184:x1874715918468224:12345-192.168.204.27@tcp:502: 00000100:00100000:2.0:1787868620.147244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6184:x1874715918468224:12345-192.168.204.27@tcp:502: Request processed in 257us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.147253:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:0.0:1787868620.187021:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.187205:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468352 00000100:00100000:2.0:1787868620.187225:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468352 00000100:00100000:2.0:1787868620.187282:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:2.0:1787868620.187293:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6165:x1874715918468352:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1787868620.187328:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868620.187347:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870600/0x2f11f4d3bde2d007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.187375:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870600/0x2f11f4d3bde2d007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee3a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.187386:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870600/0x2f11f4d3bde2d007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee3a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.187395:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870600, rc 0) 00000100:00100000:2.0:1787868620.187574:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6165:x1874715918468352:12345-192.168.204.27@tcp:101: Request processed in 282us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.187581:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:3.0:1787868620.200007:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868620.200117:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468480 00000100:00100000:1.0:1787868620.200139:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468480 00000100:00100000:1.0:1787868620.200412:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:1.0:1787868620.200424:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6165:x1874715918468480:12345-192.168.204.27@tcp:256: 20000000:01000000:1.0:1787868620.201689:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787868620.201722:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787868620.201726:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787868620.201729:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787868620.201732:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787868620.201735:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787868620.220109:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6165:x1874715918468480:12345-192.168.204.27@tcp:256: Request processed in 19668us (20093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868620.220141:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:0.0:1787868620.227050:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.227258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468608 00000100:00100000:2.0:1787868620.227272:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468608 00000100:00100000:2.0:1787868620.227396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:2.0:1787868620.227411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6165:x1874715918468608:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1787868620.227434:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868620.227459:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee41 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.227495:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.227520:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868620.227531:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868620.227643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6165:x1874715918468608:12345-192.168.204.27@tcp:101: Request processed in 235us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.227650:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1787868620.230890:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868620.231270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468736 00000100:00100000:0.0:1787868620.231300:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468736 00000100:00100000:0.0:1787868620.231373:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:0.0:1787868620.231386:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6165:x1874715918468736:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1787868620.231635:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6165:x1874715918468736:12345-192.168.204.27@tcp:501: Request processed in 251us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868620.231645:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:1.0:1787868620.235753:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868620.236209:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468864 00000100:00100000:2.0:1787868620.236231:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468864 00000100:00100000:2.0:1787868620.236311:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:2.0:1787868620.236324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6165:x1874715918468864:12345-192.168.204.27@tcp:503: 00000100:00100000:2.0:1787868620.236550:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6165:x1874715918468864:12345-192.168.204.27@tcp:503: Request processed in 227us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868620.236559:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:1.0:1787868620.240332:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868620.240786:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918468992 00000100:00100000:0.0:1787868620.240800:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918468992 00000100:00100000:0.0:1787868620.240877:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1787868620.240889:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6191:x1874715918468992:12345-192.168.204.27@tcp:502: 00000100:00100000:0.0:1787868620.241132:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6191:x1874715918468992:12345-192.168.204.27@tcp:502: Request processed in 243us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868620.241141:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:1.0:1787868620.245718:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.246099:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469120 00000100:00100000:3.0:1787868620.246114:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469120 00000100:00100000:3.0:1787868620.246369:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:3.0:1787868620.246382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6191:x1874715918469120:12345-192.168.204.27@tcp:502: 00000100:00100000:3.0:1787868620.246622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6191:x1874715918469120:12345-192.168.204.27@tcp:502: Request processed in 242us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868620.246631:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:1.0:1787868620.252036:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.252325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469248 00000100:00100000:3.0:1787868620.252340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469248 00000100:00100000:3.0:1787868620.252421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868620.252434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874715918469248:12345-192.168.204.27@tcp:38: 00010000:00080000:3.0:1787868620.252485:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1787868620.252605:0:6514:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d015 00000004:00100000:3.0:1787868620.252647:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868620.252994:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93dab7ede800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868620.253105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918469248:12345-192.168.204.27@tcp:38: Request processed in 672us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868620.253115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868620.267416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868620.268201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469504 00000100:00100000:3.0:1787868620.268343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469504 00000100:00100000:3.0:1787868620.268425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868620.268436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918469504:12345-192.168.204.27@tcp:38: 00010000:00080000:3.0:1787868620.268484:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1787868620.268562:0:6512:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d01c 00000004:00100000:3.0:1787868620.268618:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868620.268923:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dab7edc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868620.270691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918469504:12345-192.168.204.27@tcp:38: Request processed in 2241us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868620.270708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00010000:00010000:3.0:1787868620.899005:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868621.267132:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868621.267222:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868621.267467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469760 00000100:00100000:3.0:1787868621.267482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469760 00000100:00100000:3.0:1787868621.267572:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469376 00000100:00100000:3.0:1787868621.267575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469376 00000100:00100000:3.0:1787868621.267597:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868621.267607:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+7:6165:x1874715918469760:12345-192.168.204.27@tcp:41: 00000004:00000024:3.0:1787868621.267661:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787868621.267751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+7:6165:x1874715918469760:12345-192.168.204.27@tcp:41: Request processed in 146us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868621.267760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868621.267780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787868621.267787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918469376:12345-192.168.204.27@tcp:41: 00000004:00000024:3.0:1787868621.267829:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787868621.267853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918469376:12345-192.168.204.27@tcp:41: Request processed in 66us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868621.267860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00080000:3.0:1787868621.268152:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868621.268254:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868621.268527:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469632 00000100:00100000:0.0:1787868621.268533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469632 00000100:00100000:0.0:1787868621.268590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1787868621.268599:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918469632:12345-192.168.204.27@tcp:41: 00000004:00000024:0.0:1787868621.268624:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868621.268669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918469632:12345-192.168.204.27@tcp:41: Request processed in 72us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868621.268676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:2.0:1787868621.268867:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868621.282861:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868621.283016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918469888 00000100:00100000:0.0:1787868621.283032:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918469888 00000100:00100000:0.0:1787868621.283131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1787868621.283145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918469888:12345-192.168.204.27@tcp:40: 00000100:00100000:0.0:1787868621.283310:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918469888:12345-192.168.204.27@tcp:40: Request processed in 168us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868621.283342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1787868621.287220:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868621.287294:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868621.287353:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868621.287394:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868621.287437:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470016 00000100:00100000:1.0:1787868621.287451:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470016 00000100:00100000:1.0:1787868621.287500:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470144 00000100:00100000:1.0:1787868621.287504:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470144 00000100:00100000:1.0:1787868621.287523:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1787868621.287533:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874715918470016:12345-192.168.204.27@tcp:8: 00010000:00080000:1.0:1787868621.287595:0:8962:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787868621.287637:0:8962:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d023 00002000:00100000:1.0:1787868621.287655:0:8962:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 666039a7-1461-4e99-8c4e-10237114565a/ffff93dab6f6c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1787868621.287893:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470400 00000100:00100000:2.0:1787868621.287898:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470400 00000100:00100000:2.0:1787868621.287947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:2.0:1787868621.287956:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918470400:12345-192.168.204.27@tcp:400: 00000100:00100000:2.0:1787868621.288059:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918470400:12345-192.168.204.27@tcp:400: Request processed in 103us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868621.288067:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:2.0:1787868621.288147:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787868621.288184:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918470144:12345-192.168.204.27@tcp:8: 00010000:00080000:2.0:1787868621.288208:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1787868621.288230:0:8430:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d02a 00002000:00100000:2.0:1787868621.288236:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 666039a7-1461-4e99-8c4e-10237114565a/ffff93d986312800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787868621.288271:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787868621.288493:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787868621.288537:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93d986310000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868621.288574:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918470144:12345-192.168.204.27@tcp:8: Request processed in 420us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868621.288582:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1787868621.288969:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470272 00000100:00100000:0.0:1787868621.288976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470272 00000100:00100000:0.0:1787868621.289026:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868621.289035:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918470272:12345-192.168.204.27@tcp:900: 00000100:00100000:0.0:1787868621.289096:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918470272:12345-192.168.204.27@tcp:900: Request processed in 64us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868621.289115:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00002000:00100000:1.0:1787868621.292837:0:8962:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787868621.293137:0:8962:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787868621.293224:0:8962:0:(import.c:65:import_set_state_nolock()) ffff93dab6f6a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868621.293339:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918470016:12345-192.168.204.27@tcp:8: Request processed in 5804us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868621.293354:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1787868621.297303:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868621.297623:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470528 00000100:00100000:0.0:1787868621.297638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470528 00000100:00100000:0.0:1787868621.297741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868621.297755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918470528:12345-192.168.204.27@tcp:33: 00000004:00080000:3.0:1787868621.351236:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 53335us 00000004:00200000:3.0:1787868621.398506:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787868621.398749:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+6:6165:x1874715918470528:12345-192.168.204.27@tcp:33: Request processed in 100992us (101457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868621.398776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1787868621.909308:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868621.910318:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470656 00000100:00100000:3.0:1787868621.910331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470656 00000100:00100000:3.0:1787868621.910418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787868621.910438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:6208:x1874715918470656:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1787868621.910459:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868621.910546:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20ffc00/0x2f11f4d3bde2d031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee72 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910617:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910632:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910648:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868621.910696:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787868621.910701:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868621.910717:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910745:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20ffc00/0x2f11f4d3bde2d031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee72 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910768:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee72 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868621.910797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316800) 00010000:00010000:3.0:1787868621.910800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868621.910803:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20fec00, rc 0) 00000100:00100000:3.0:1787868621.911628:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+7:6208:x1874715918470656:12345-192.168.204.27@tcp:101: Request processed in 459us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868621.911639:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:1.0:1787868621.921558:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868622.945932:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868623.141606:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939490688:0@lo:13: 00000100:00100000:0.0:1787868623.141687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868623.141818:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868623.141835:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868623.141837:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939490944:0@lo:41: 00000100:00100000:0.0:1787868623.141847:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939490816:0@lo:13: 00000100:00100000:1.0:1787868623.141881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.141887:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868623.141990:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490688 00000100:00100000:2.0:1787868623.141999:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490688 00000100:00100000:2.0:1787868623.142054:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490816 00000100:00100000:2.0:1787868623.142058:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490816 00000100:00100000:2.0:1787868623.142099:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787868623.142102:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939491328:0@lo:400: 00000100:00100000:2.0:1787868623.142112:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939490688:12345-0@lo:13: 00002000:00000024:2.0:1787868623.142145:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868623.142150:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939491072:0@lo:400: 00000100:00100000:0.0:1787868623.142322:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939491200:0@lo:400: 00000100:00100000:0.0:1787868623.142349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.142381:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939491712:0@lo:400: 00000100:00100000:0.0:1787868623.142403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.142418:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492224:0@lo:400: 00000100:00100000:0.0:1787868623.142438:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.142478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491200 00000100:00100000:0.0:1787868623.142494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491200 00000100:00100000:0.0:1787868623.142520:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491712 00000100:00100000:0.0:1787868623.142522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491712 00000100:00100000:0.0:1787868623.142535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787868623.142540:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939491200:12345-0@lo:400: 00000100:00100000:0.0:1787868623.142580:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939491200:12345-0@lo:400: Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.142587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787868623.142604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868623.142610:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939491712:12345-0@lo:400: 00000100:00100000:0.0:1787868623.142635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939491712:12345-0@lo:400: Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.142640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868623.142674:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939491200:0@lo:400: 00010000:00080000:0.0:1787868623.142684:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700da40 x1874715939491712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868623.142694:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939491712:0@lo:400: 00000100:00100000:0.0:1787868623.142724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939490944 00000100:00100000:0.0:1787868623.142727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939490944 00000100:00100000:0.0:1787868623.142749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868623.142754:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939490944:12345-0@lo:41: 00000100:00100000:3.0:1787868623.143517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868623.143554:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939491840:0@lo:400: 00000100:00100000:3.0:1787868623.143586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1787868623.143735:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787868623.144059:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939490944:12345-0@lo:41: Request processed in 1303us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.144081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868623.144119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491328 00000100:00100000:0.0:1787868623.144140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491328 00000100:00100000:0.0:1787868623.144255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868623.144264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939491328:12345-0@lo:400: 00000100:00100000:0.0:1787868623.144305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939491328:12345-0@lo:400: Request processed in 43us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.144311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787868623.144422:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939492352:0@lo:400: 00000100:00100000:3.0:1787868623.144453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868623.144491:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939491328:0@lo:400: 00000100:00100000:0.0:1787868623.144505:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492224 00000100:00100000:0.0:1787868623.144511:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492224 00000100:00100000:3.0:1787868623.144538:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491840 00000100:00100000:3.0:1787868623.144544:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491840 00000100:00100000:0.0:1787868623.144547:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492352 00000100:00100000:0.0:1787868623.144552:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492352 00000100:00100000:3.0:1787868623.144574:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787868623.144581:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787868623.144594:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939491840:12345-0@lo:400: 00000100:00100000:0.0:1787868623.144632:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939491840:12345-0@lo:400: Request processed in 42us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.144638:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787868623.144649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868623.144655:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939492352:12345-0@lo:400: 00000100:00100000:0.0:1787868623.144681:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939492352:12345-0@lo:400: Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.144686:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787868623.144702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868623.144706:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868623.144708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868623.144735:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939491456:0@lo:400: 00000100:00100000:0.0:1787868623.144763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.144782:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939491968:0@lo:400: 00000100:00100000:0.0:1787868623.144821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868623.144893:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492224:12345-0@lo:400: 00000100:00100000:3.0:1787868623.144942:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492224:12345-0@lo:400: Request processed in 360us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868623.144949:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868623.144970:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491456 00000100:00100000:3.0:1787868623.144974:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491456 00000100:00100000:3.0:1787868623.145000:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787868623.145007:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939491456:12345-0@lo:400: 00000100:00100000:3.0:1787868623.145053:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939491456:12345-0@lo:400: Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868623.145059:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787868623.145101:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700ed00 x1874715939491840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.145112:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939491840:0@lo:400: 00010000:00080000:3.0:1787868623.145120:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700e580 x1874715939492352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.145127:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939492352:0@lo:400: 00010000:00080000:3.0:1787868623.145153:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700c780 x1874715939492224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.145189:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492224:0@lo:400: 00000100:00100000:0.0:1787868623.145302:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939491456:0@lo:400: 00000100:00100000:0.0:1787868623.145329:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491968 00000100:00100000:0.0:1787868623.145333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491968 00000100:00100000:0.0:1787868623.145381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787868623.145389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939491968:12345-0@lo:400: 00000100:00100000:0.0:1787868623.145427:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939491968:12345-0@lo:400: Request processed in 40us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.145433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787868623.145460:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939491968:0@lo:400: 00000100:00080000:3.0:1787868623.145727:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868623.148541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868623.148606:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939491584:0@lo:400: 00000100:00100000:2.0:1787868623.148618:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939490688:12345-0@lo:13: Request processed in 6506us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868623.148631:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868623.148653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868623.148667:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868623.148683:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939490816:12345-0@lo:13: 00000100:00100000:1.0:1787868623.148703:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939492096:0@lo:400: 00002000:00000024:2.0:1787868623.148709:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868623.148731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868623.148760:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939490816:12345-0@lo:13: Request processed in 81us (6872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868623.148767:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868623.148785:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939490944:0@lo:41: 00000100:00100000:2.0:1787868623.148826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491584 00000100:00100000:1.0:1787868623.148830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492096 00000100:00100000:2.0:1787868623.148832:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491584 00000100:00100000:2.0:1787868623.148877:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787868623.148882:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939491584:12345-0@lo:400: 00000100:00100000:2.0:1787868623.149031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939491584:12345-0@lo:400: Request processed in 147us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868623.149038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787868623.149053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868623.149275:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492096 00000100:00100000:1.0:1787868623.149312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868623.149319:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939492096:12345-0@lo:400: 00000100:00100000:1.0:1787868623.149356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939492096:12345-0@lo:400: Request processed in 38us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868623.149362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868623.149393:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939491584:0@lo:400: 00010000:00080000:1.0:1787868623.149405:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700cf00 x1874715939492096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868623.149416:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939492096:0@lo:400: 00010000:00080000:3.0:1787868623.149700:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1c000 x1874715939490816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.149715:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939490816:0@lo:13: 00010000:00080000:3.0:1787868623.149729:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700f840 x1874715939490688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.149741:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939490688:0@lo:13: 00000100:00100000:0.0:1787868623.152333:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939491072 00000100:00100000:0.0:1787868623.152351:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939491072 00000100:00100000:0.0:1787868623.152437:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787868623.152449:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939491072:12345-0@lo:400: 00000100:00100000:0.0:1787868623.152563:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939491072:12345-0@lo:400: Request processed in 117us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.152570:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1787868623.152893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868623.152973:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939491072:0@lo:400: 00000100:00100000:0.0:1787868623.649533:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939492480:0@lo:13: 00000100:00100000:0.0:1787868623.649616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868623.649717:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492480 00000100:00100000:0.0:1787868623.649725:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492480 00000100:00100000:0.0:1787868623.649767:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868623.649776:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939492480:12345-0@lo:13: 00002000:00000024:0.0:1787868623.649807:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868623.649850:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939492480:12345-0@lo:13: Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868623.649857:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787868623.649895:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f97840 x1874715939492480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868623.649920:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939492480:0@lo:13: 00000100:00100000:3.0:1787868623.650392:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492736:0@lo:13: 00000100:00100000:3.0:1787868623.650430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868623.650520:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492736 00000100:00100000:1.0:1787868623.650524:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492736 00000100:00100000:1.0:1787868623.650548:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787868623.650555:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492736:12345-0@lo:13: 00002000:00000024:1.0:1787868623.650569:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868623.650610:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492736:12345-0@lo:13: Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868623.650617:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787868623.650689:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f97840 x1874715939492736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868623.650717:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492736:0@lo:13: 00000100:00100000:0.0:1787868623.650975:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868623.650990:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939492608:0@lo:41: 00000100:00100000:0.0:1787868623.651025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868623.651112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492608 00000100:00100000:1.0:1787868623.651118:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492608 00000100:00100000:1.0:1787868623.651177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868623.651185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939492608:12345-0@lo:41: 00000004:00000024:1.0:1787868623.651209:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868623.651255:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939492608:12345-0@lo:41: Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868623.651261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000001:00100000:3.0:1787868623.651748:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000100:00100000:0.0:1787868623.653988:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939492608:0@lo:41: 00010000:00010000:3.0:1787868623.969822:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868624.242251:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868624.242357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470784 00000100:00100000:1.0:1787868624.242367:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470784 00000100:00100000:1.0:1787868624.242508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1787868624.242521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+7:6262:x1874715918470784:12345-192.168.204.27@tcp:41: 00000004:00000024:1.0:1787868624.242566:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787868624.242657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+7:6262:x1874715918470784:12345-192.168.204.27@tcp:41: Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868624.242665:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:2.0:1787868624.242701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868624.252005:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868624.252366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918470912 00000100:00100000:0.0:1787868624.252386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918470912 00000100:00100000:0.0:1787868624.252504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1787868624.252518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:6262:x1874715918470912:12345-192.168.204.27@tcp:41: 00000004:00000024:0.0:1787868624.252577:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868624.252695:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:6262:x1874715918470912:12345-192.168.204.27@tcp:41: Request processed in 180us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868624.252703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:2.0:1787868624.253752:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868624.255894:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868624.255978:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471040 00000100:00100000:1.0:1787868624.255999:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471040 00000100:00080000:2.0:1787868624.256186:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868624.256239:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1787868624.256254:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:666039a7-1461-4e99-8c4e-10237114565a+6:6262:x1874715918471040:12345-192.168.204.27@tcp:13: 00002000:00000024:1.0:1787868624.256295:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868624.256400:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:666039a7-1461-4e99-8c4e-10237114565a+6:6262:x1874715918471040:12345-192.168.204.27@tcp:13: Request processed in 150us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868624.256409:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1787868624.262681:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868624.262813:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471168 00000100:00100000:3.0:1787868624.262832:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471168 00000100:00080000:2.0:1787868624.262995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868624.263120:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868624.263134:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:666039a7-1461-4e99-8c4e-10237114565a+5:6262:x1874715918471168:12345-192.168.204.27@tcp:13: 00002000:00000024:3.0:1787868624.263251:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868624.263351:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:666039a7-1461-4e99-8c4e-10237114565a+5:6262:x1874715918471168:12345-192.168.204.27@tcp:13: Request processed in 220us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868624.263360:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:3.0:1787868624.994319:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787868625.703184:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000001:00100000:2.0:1787868625.706976:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00010000:00010000:2.0:1787868626.020200:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868626.651735:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868626.651850:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868626.651901:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868626.651960:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868626.654461:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471680 00000100:00100000:3.0:1787868626.654486:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471680 00000100:00100000:3.0:1787868626.654624:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1787868626.654641:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918471680:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1787868626.654760:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918471680:12345-192.168.204.27@tcp:400: Request processed in 124us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868626.654768:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:3.0:1787868626.654803:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868626.655031:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471296 00000100:00100000:3.0:1787868626.655037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471296 00000100:00100000:3.0:1787868626.655078:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:3.0:1787868626.655086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918471296:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1787868626.655132:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918471296:12345-192.168.204.27@tcp:400: Request processed in 47us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868626.655138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:1.0:1787868626.661213:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868626.661265:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471808 00000100:00100000:1.0:1787868626.661279:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471808 00000100:00100000:1.0:1787868626.661374:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1787868626.661388:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918471808:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1787868626.661498:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918471808:12345-192.168.204.27@tcp:400: Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868626.661507:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00080000:1.0:1787868626.661848:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868626.663203:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471424 00000100:00100000:0.0:1787868626.663222:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471424 00000100:00080000:1.0:1787868626.663475:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868626.667194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471552 00000100:00100000:3.0:1787868626.667218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471552 00000100:00100000:3.0:1787868626.667316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1787868626.667331:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918471424:12345-192.168.204.27@tcp:400: 00000100:00080000:1.0:1787868626.667396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868626.667460:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918471424:12345-192.168.204.27@tcp:400: Request processed in 133us (15746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868626.667469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1787868626.667491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1787868626.667497:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918471552:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1787868626.667524:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918471552:12345-192.168.204.27@tcp:400: Request processed in 28us (15565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868626.667530:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000001:00100000:2.0:1787868626.726038:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00010000:00010000:3.0:1787868627.042684:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787868627.412501:0:10178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787868628.065520:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868628.257644:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868628.257678:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492864:0@lo:41: 00000100:00100000:0.0:1787868628.257754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868628.257996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492864 00000100:00100000:1.0:1787868628.258007:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492864 00000100:00100000:1.0:1787868628.258067:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868628.258077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492864:12345-0@lo:41: 00000004:00000024:1.0:1787868628.258109:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787868628.258187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939492864:12345-0@lo:41: Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.258195:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787868628.259389:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939492864:0@lo:41: 00000100:00100000:0.0:1787868628.261110:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939493120:0@lo:13: 00000100:00100000:0.0:1787868628.261196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868628.261251:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868628.261269:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939492992:0@lo:13: 00000100:00100000:0.0:1787868628.261307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868628.261408:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493120 00000100:00100000:3.0:1787868628.261415:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493120 00000100:00100000:3.0:1787868628.261464:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939492992 00000100:00100000:3.0:1787868628.261467:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939492992 00000100:00100000:3.0:1787868628.261484:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868628.261492:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939493120:12345-0@lo:13: 00002000:00000024:3.0:1787868628.261532:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868628.261590:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939493120:12345-0@lo:13: Request processed in 98us (393us total) trans 0 rc 0/0 00010000:00080000:2.0:1787868628.261752:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393d2c0 x1874715939493120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868628.261771:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939493120:0@lo:13: 00000100:00100000:3.0:1787868628.261855:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868628.261874:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868628.261881:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939492992:12345-0@lo:13: 00002000:00000024:3.0:1787868628.261892:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868628.261934:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939492992:12345-0@lo:13: Request processed in 54us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868628.261940:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787868628.262143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868628.262278:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:2.0:1787868628.262368:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0d2c0 x1874715939492992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868628.262384:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939492992:0@lo:13: 00000100:00100000:0.0:1787868628.262542:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868628.262565:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939493376:0@lo:400: 00000100:00100000:0.0:1787868628.262611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868628.262736:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493376 00000100:00100000:2.0:1787868628.262741:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493376 00000100:00100000:2.0:1787868628.262787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868628.262796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939493376:12345-0@lo:400: 00000100:00100000:2.0:1787868628.262842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939493376:12345-0@lo:400: Request processed in 48us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868628.262849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787868628.262930:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939493376:0@lo:400: 00000100:00100000:3.0:1787868628.264361:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939493248:0@lo:400: 00000100:00100000:3.0:1787868628.264419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868628.269041:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493248 00000100:00100000:2.0:1787868628.269072:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493248 00000100:00100000:2.0:1787868628.269709:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787868628.269722:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939493248:12345-0@lo:400: 00000100:00100000:2.0:1787868628.269870:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939493248:12345-0@lo:400: Request processed in 152us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868628.269879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787868628.270250:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939493248:0@lo:400: 00000100:00100000:3.0:1787868628.270553:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939493504:0@lo:400: 00000100:00100000:3.0:1787868628.270606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868628.270678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493504 00000100:00100000:0.0:1787868628.270684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493504 00000100:00100000:0.0:1787868628.270721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787868628.270728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939493504:12345-0@lo:400: 00000100:00100000:2.0:1787868628.270942:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939493632:0@lo:400: 00000100:00100000:2.0:1787868628.270988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868628.271027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493632 00000100:00100000:2.0:1787868628.271031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493632 00000100:00100000:2.0:1787868628.271054:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787868628.271060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939493632:12345-0@lo:400: 00000100:00100000:2.0:1787868628.271094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939493632:12345-0@lo:400: Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868628.271115:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787868628.271146:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939493632:0@lo:400: 00000100:00100000:0.0:1787868628.271384:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939493504:12345-0@lo:400: Request processed in 656us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868628.271392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787868628.271438:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939493504:0@lo:400: 00000100:00100000:0.0:1787868628.271584:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939493760:0@lo:400: 00000100:00100000:0.0:1787868628.271611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868628.271727:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493760 00000100:00100000:2.0:1787868628.271732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493760 00000100:00100000:2.0:1787868628.271771:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787868628.271778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939493760:12345-0@lo:400: 00000100:00080000:3.0:1787868628.271874:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868628.272002:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939493888:0@lo:400: 00000100:00100000:3.0:1787868628.272033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868628.272061:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868628.272068:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787868628.272205:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939493888 00000100:00100000:3.0:1787868628.272208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939493888 00000100:00100000:3.0:1787868628.272229:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868628.272236:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787868628.272241:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939493888:12345-0@lo:400: 00000100:00100000:3.0:1787868628.272271:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939493888:12345-0@lo:400: Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868628.272278:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787868628.272303:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868628.272323:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8cb40 x1874715939493888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868628.272335:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939493888:0@lo:400: 00000100:00100000:2.0:1787868628.272868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939493760:12345-0@lo:400: Request processed in 1087us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868628.272878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787868628.273053:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939494016:0@lo:400: 00000100:00100000:3.0:1787868628.273087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868628.273478:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494016 00000100:00100000:2.0:1787868628.273483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494016 00000100:00100000:2.0:1787868628.273524:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787868628.273532:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939494016:12345-0@lo:400: 00000100:00100000:0.0:1787868628.274352:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939493760:0@lo:400: 00000100:00100000:2.0:1787868628.274519:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939494016:12345-0@lo:400: Request processed in 986us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868628.274528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787868628.274550:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868628.274780:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939494400:0@lo:400: 00000100:00100000:1.0:1787868628.274824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868628.274847:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868628.274852:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939494272:0@lo:400: 00000100:00100000:1.0:1787868628.274871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868628.274893:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494400 00000100:00100000:1.0:1787868628.274897:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494400 00000100:00100000:1.0:1787868628.274932:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494272 00000100:00100000:1.0:1787868628.274941:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494272 00000100:00100000:1.0:1787868628.274980:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868628.274988:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939494400:12345-0@lo:400: 00000100:00100000:1.0:1787868628.275028:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939494400:12345-0@lo:400: Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.275034:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868628.275046:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787868628.275052:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939494272:12345-0@lo:400: 00000100:00100000:1.0:1787868628.275074:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939494272:12345-0@lo:400: Request processed in 23us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.275079:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787868628.275353:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868628.275365:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939494144:0@lo:400: 00000100:00100000:0.0:1787868628.275396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787868628.275470:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8f480 x1874715939494272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868628.275482:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939494272:0@lo:400: 00010000:00080000:1.0:1787868628.275492:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8e940 x1874715939494400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868628.275500:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939494400:0@lo:400: 00000100:00100000:1.0:1787868628.275527:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494144 00000100:00100000:1.0:1787868628.275530:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494144 00000100:00100000:1.0:1787868628.275696:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868628.275704:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939494144:12345-0@lo:400: 00000100:00100000:1.0:1787868628.275742:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939494144:12345-0@lo:400: Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.275749:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787868628.275771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787868628.275821:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8e1c0 x1874715939494144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868628.275831:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939494144:0@lo:400: 00000100:00100000:3.0:1787868628.275955:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939494016:0@lo:400: 00000100:00100000:3.0:1787868628.769487:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939494528:0@lo:13: 00000100:00100000:3.0:1787868628.769562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868628.769723:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494528 00000100:00100000:1.0:1787868628.769749:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494528 00000100:00100000:1.0:1787868628.769805:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787868628.769815:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939494528:12345-0@lo:13: 00002000:00000024:1.0:1787868628.769843:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868628.769890:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939494528:12345-0@lo:13: Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.769897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787868628.769988:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8e940 x1874715939494528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868628.770008:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939494528:0@lo:13: 00000100:00100000:3.0:1787868628.770248:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868628.770257:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939494656:0@lo:41: 00000100:00100000:3.0:1787868628.770288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868628.770319:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494656 00000100:00100000:3.0:1787868628.770323:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494656 00000100:00100000:3.0:1787868628.770428:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787868628.770436:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939494656:12345-0@lo:41: 00000004:00000024:3.0:1787868628.770461:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868628.770498:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939494656:12345-0@lo:41: Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868628.770505:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787868628.770539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939494656:0@lo:41: 00000100:00100000:0.0:1787868628.770708:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939494784:0@lo:13: 00000100:00100000:0.0:1787868628.770764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868628.770949:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939494784 00000100:00100000:1.0:1787868628.770964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939494784 00000100:00100000:1.0:1787868628.770999:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787868628.771006:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939494784:12345-0@lo:13: 00002000:00000024:1.0:1787868628.771019:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868628.771060:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939494784:12345-0@lo:13: Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868628.771066:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787868628.771148:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8f480 x1874715939494784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868628.771190:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939494784:0@lo:13: 00010000:00010000:2.0:1787868629.090492:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868630.114442:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868631.137593:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868631.771352:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868631.771859:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868631.771913:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868631.771945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868631.772235:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918471936 00000100:00100000:0.0:1787868631.772246:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918471936 00000100:00100000:0.0:1787868631.773111:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:3.0:1787868631.773117:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472320 00000100:00100000:3.0:1787868631.773124:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472320 00000100:00100000:0.0:1787868631.773130:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2404:x1874715918471936:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1787868631.773219:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868631.773229:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472320:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1787868631.773239:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2404:x1874715918471936:12345-192.168.204.27@tcp:400: Request processed in 116us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.773249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:3.0:1787868631.773265:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472320:12345-192.168.204.27@tcp:400: Request processed in 37us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868631.773274:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00080000:3.0:1787868631.774251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868631.776201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472064 00000100:00100000:2.0:1787868631.776217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472064 00000100:00100000:3.0:1787868631.776223:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472192 00000100:00100000:3.0:1787868631.776229:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472192 00000100:00100000:2.0:1787868631.776299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1787868631.776309:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1787868631.776312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918472064:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1787868631.776323:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472192:12345-192.168.204.27@tcp:400: 00000100:00080000:3.0:1787868631.776337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868631.776342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868631.776378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918472064:12345-192.168.204.27@tcp:400: Request processed in 71us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.776387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1787868631.776477:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472192:12345-192.168.204.27@tcp:400: Request processed in 158us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868631.776487:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1787868631.776701:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868631.777192:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472448 00000100:00100000:2.0:1787868631.777198:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472448 00000100:00100000:2.0:1787868631.777653:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787868631.777663:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472448:12345-192.168.204.27@tcp:400: 00000100:00100000:2.0:1787868631.777706:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918472448:12345-192.168.204.27@tcp:400: Request processed in 45us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.777714:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00080000:2.0:1787868631.777736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1787868631.952417:0:10327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6b002300 20000000:00000080:3.0:1787868631.952436:0:10327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93dab7f09800 uarg=0000000000000000 20000000:01000000:3.0:1787868631.952484:0:10327:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787868631.952487:0:10327:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787868631.952489:0:10327:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787868631.952493:0:10327:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787868631.952498:0:10327:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787868631.952553:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787868631.952556:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787868631.953008:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1787868631.953299:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1787868631.953328:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1787868631.953345:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1787868631.953356:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787868631.953358:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787868631.953865:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787868631.954024:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787868631.954045:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787868631.954060:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787868631.954069:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787868631.954071:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787868631.954546:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787868631.954879:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787868631.954937:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787868631.954959:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1787868631.954967:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787868631.954968:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787868631.961232:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787868631.961801:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787868631.961835:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787868631.961864:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787868631.961877:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787868631.961880:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787868631.962634:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787868631.962888:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787868631.962925:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787868631.962949:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1787868631.962964:0:10327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787868631.962984:0:10327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963116:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963124:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963130:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963136:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963143:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963149:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963184:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963192:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963199:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963209:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963226:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963234:0:10327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963274:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963301:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 9 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.963542:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939494912:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868631.963760:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963770:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 9 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.963780:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495040:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868631.963813:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.963821:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.963829:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495168:0@lo:104: 00000100:00100000:3.0:1787868631.963884:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.964116:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495168 00000100:00100000:0.0:1787868631.964122:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495168 00000100:00100000:0.0:1787868631.964195:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868631.964204:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495168:12345-0@lo:104: 00010000:00010000:0.0:1787868631.964217:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.964266:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868631.964271:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495168:12345-0@lo:104: Request processed in 69us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.964278:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787868631.964907:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.964917:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 23 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.964927:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495296:0@lo:104: 00000100:00100000:3.0:1787868631.964966:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868631.965070:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495296 00000100:00100000:2.0:1787868631.965074:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495296 00000100:00100000:2.0:1787868631.965097:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868631.965104:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495296:12345-0@lo:104: 00010000:00010000:2.0:1787868631.965114:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965188:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787868631.965193:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495296:12345-0@lo:104: Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.965200:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787868631.965217:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868631.965222:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965230:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868631.965234:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965242:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868631.965249:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868631.965255:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868631.965301:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965308:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868631.965326:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965333:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031600/0x2f11f4d3bde2cfdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfe4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965357:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868631.965360:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965366:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868631.965369:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965376:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868631.965383:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868631.965388:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868631.965399:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965404:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868631.965418:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965424:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2cfba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.965432:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868631.965434:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868631.965436:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868631.965441:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868631.965456:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939495424:0@lo:103: 00000100:00100000:2.0:1787868631.965484:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868631.965514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939495552:0@lo:103: 00000100:00100000:2.0:1787868631.965533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868631.965562:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495424 00000100:00100000:2.0:1787868631.965566:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495424 00010000:00010000:2.0:1787868631.965581:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 24 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.966224:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.966235:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 24 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.966245:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495680:0@lo:104: 00000100:00100000:3.0:1787868631.966270:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868631.966337:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.966345:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 24 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868631.966354:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495808:0@lo:104: 00000100:00100000:3.0:1787868631.966377:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868631.966431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495552 00000100:00100000:2.0:1787868631.966435:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495552 00010000:00010000:2.0:1787868631.966451:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 25 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.966473:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868631.966480:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3637:x1874715939495424:12345-0@lo:103: 00010000:00010000:2.0:1787868631.966491:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868631.966496:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 25 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.966505:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 25 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.966522:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868631.966554:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3637:x1874715939495424:12345-0@lo:103: Request processed in 74us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.966560:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868631.966614:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868631.966620:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939495552:12345-0@lo:103: 00010000:00010000:2.0:1787868631.966646:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868631.966651:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 24 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.966659:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 24 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.966669:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868631.966698:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939495552:12345-0@lo:103: Request processed in 78us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.966704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868631.966747:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939495552:0@lo:103: 00000100:00100000:2.0:1787868631.966771:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939495424:0@lo:103: 00010000:00010000:2.0:1787868631.968101:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.968114:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968126:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495936:0@lo:104: 00010000:00010000:2.0:1787868631.968181:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.968190:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 23 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968199:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496064:0@lo:104: 00010000:00010000:2.0:1787868631.968224:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.968243:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 23 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968252:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496192:0@lo:104: 00010000:00010000:2.0:1787868631.968279:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.968287:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968296:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496320:0@lo:104: 00010000:00010000:2.0:1787868631.968320:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.968328:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 23 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968335:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496448:0@lo:104: 00000100:00100000:2.0:1787868631.968352:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727ab40 going to sleep for 11 seconds 00010000:00010000:2.0:1787868631.968373:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2cfe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfdd expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968383:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495168:0@lo:104: 00010000:00010000:2.0:1787868631.968393:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2cfc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cfba expref: 22 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.968402:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495296:0@lo:104: 00000100:00100000:0.0:1787868631.968558:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787868631.968582:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.969268:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868631.969547:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495680 00000100:00100000:1.0:1787868631.969556:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495680 00000100:00100000:1.0:1787868631.969591:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495808 00000100:00100000:1.0:1787868631.969594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495808 00000100:00100000:1.0:1787868631.969617:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939495936 00000100:00100000:1.0:1787868631.969620:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939495936 00000100:00100000:1.0:1787868631.969764:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868631.969773:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10327:x1874715939495680:12345-0@lo:104: 00010000:00010000:1.0:1787868631.969787:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.969852:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868631.969858:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10327:x1874715939495680:12345-0@lo:104: Request processed in 88us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868631.969865:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787868631.969881:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787868631.969888:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987178850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10327:x1874715939495808:12345-0@lo:104: 00010000:00010000:1.0:1787868631.969908:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.970091:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495680:0@lo:104: 00000100:00100000:2.0:1787868631.970112:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495808:0@lo:104: 00010000:00010000:1.0:1787868631.970149:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787868631.970180:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987178850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10327:x1874715939495808:12345-0@lo:104: Request processed in 292us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868631.970187:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787868631.970223:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787868631.970231:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495936:12345-0@lo:104: 00010000:00010000:1.0:1787868631.970246:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970288:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787868631.970293:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939495936:12345-0@lo:104: Request processed in 64us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868631.970299:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787868631.970317:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787868631.970323:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970331:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868631.970335:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970343:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868631.970351:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868631.970357:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868631.970388:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970394:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868631.970411:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970419:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2cf9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cfa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970438:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787868631.970442:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970447:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1bc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868631.970451:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970458:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868631.970465:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868631.970471:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868631.970484:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970490:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868631.970505:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970513:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2cf74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970522:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868631.970525:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970541:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868631.970544:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970551:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868631.970557:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868631.970562:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868631.970589:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970595:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787868631.970746:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495936:0@lo:104: 00010000:00010000:1.0:1787868631.970776:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970783:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2cf58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868631.970794:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868631.970795:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868631.970797:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868631.970804:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868631.970810:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868631.970821:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939496576:0@lo:103: 00000100:00100000:1.0:1787868631.970856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868631.970964:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939496704:0@lo:103: 00000100:00100000:1.0:1787868631.971063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.971183:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.971195:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.971206:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.971216:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496064 00000100:00100000:0.0:1787868631.971221:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496064 00000100:00100000:0.0:1787868631.971247:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496192 00000100:00100000:0.0:1787868631.971250:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496192 00000100:00100000:0.0:1787868631.971261:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496320 00000100:00100000:0.0:1787868631.971264:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496320 00000100:00100000:0.0:1787868631.971275:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496448 00000100:00100000:0.0:1787868631.971277:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496448 00000100:00100000:0.0:1787868631.971288:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868631.971295:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:10327:x1874715939496064:12345-0@lo:104: 00010000:00010000:0.0:1787868631.971305:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971348:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868631.971353:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:10327:x1874715939496064:12345-0@lo:104: Request processed in 59us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.971365:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868631.971379:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868631.971385:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10327:x1874715939496192:12345-0@lo:104: 00010000:00010000:0.0:1787868631.971393:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971439:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787868631.971445:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10327:x1874715939496192:12345-0@lo:104: Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.971450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868631.971462:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868631.971468:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10327:x1874715939496320:12345-0@lo:104: 00010000:00010000:0.0:1787868631.971475:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971507:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787868631.971513:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10327:x1874715939496320:12345-0@lo:104: Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.971518:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868631.971530:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868631.971536:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939496448:12345-0@lo:104: 00010000:00010000:0.0:1787868631.971543:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971568:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787868631.971573:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10327:x1874715939496448:12345-0@lo:104: Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.971585:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787868631.971815:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787868631.971820:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971827:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868631.971830:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971838:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868631.971844:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868631.971849:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868631.971871:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.971876:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787868631.971924:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939496960:0@lo:103: 00010000:00010000:0.0:1787868631.972461:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972469:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2cf4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf51 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972481:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787868631.972484:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972502:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868631.972505:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972512:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868631.972518:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868631.972523:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868631.972551:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972557:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868631.972568:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972574:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870200/0x2f11f4d3bde2cf3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972583:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868631.972586:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972591:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868631.972593:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972621:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868631.972638:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868631.972643:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868631.972657:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972661:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868631.972669:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972674:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2cefd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cf04 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972682:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868631.972685:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972690:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868631.972692:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972697:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868631.972703:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868631.972713:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787868631.972726:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972732:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868631.972735:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972741:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2ced3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ceda expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.972755:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868631.972757:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868631.972758:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868631.972771:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868631.972782:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939497088:0@lo:103: 00010000:00010000:0.0:1787868631.972813:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868631.973296:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497216:0@lo:103: 00000100:00100000:1.0:1787868631.973324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868631.973581:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496576 00000100:00100000:2.0:1787868631.973588:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496576 00010000:00010000:2.0:1787868631.973887:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 22 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.973931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496704 00000100:00100000:2.0:1787868631.973935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496704 00000100:00100000:3.0:1787868631.974077:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787868631.974091:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:3639:x1874715939496576:12345-0@lo:103: 00010000:00010000:3.0:1787868631.974104:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868631.974110:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.974131:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.974147:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2cfa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf9e expref: 23 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868631.974179:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868631.974217:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:3639:x1874715939496576:12345-0@lo:103: Request processed in 131us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868631.974223:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787868631.974298:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 21 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.974324:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868631.974331:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3636:x1874715939496704:12345-0@lo:103: 00010000:00010000:2.0:1787868631.974338:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868631.974342:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 21 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.974350:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 21 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.974360:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2cf7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf74 expref: 21 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.974368:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868631.974394:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3636:x1874715939496704:12345-0@lo:103: Request processed in 64us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868631.974400:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868631.974442:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496064:0@lo:104: 00000100:00100000:2.0:1787868631.974463:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496192:0@lo:104: 00000100:00100000:2.0:1787868631.974472:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496320:0@lo:104: 00000100:00100000:2.0:1787868631.974479:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939496448:0@lo:104: 00000100:00100000:1.0:1787868631.974765:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939496704:0@lo:103: 00000100:00100000:1.0:1787868631.974786:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787868631.974794:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939496832:0@lo:103: 00000100:00100000:1.0:1787868631.974818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868631.974939:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497344:0@lo:103: 00000100:00100000:1.0:1787868631.974972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.975109:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497216 00000100:00100000:0.0:1787868631.975115:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497216 00010000:00010000:0.0:1787868631.975136:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 20 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.975173:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496832 00000100:00100000:0.0:1787868631.975177:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496832 00010000:00010000:0.0:1787868631.975189:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 21 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.975202:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868631.975208:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3636:x1874715939497216:12345-0@lo:103: 00010000:00010000:0.0:1787868631.975228:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.975233:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 21 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975243:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 21 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975256:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030a00/0x2f11f4d3bde2cf04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cefd expref: 21 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975265:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.975293:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3636:x1874715939497216:12345-0@lo:103: Request processed in 85us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.975299:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868631.975312:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868631.975319:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3636:x1874715939496832:12345-0@lo:103: 00010000:00010000:0.0:1787868631.975327:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.975331:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 19 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975338:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 19 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975348:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2cf5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf58 expref: 19 pid: 6505 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975356:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.975376:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3636:x1874715939496832:12345-0@lo:103: Request processed in 59us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.975392:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868631.975415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.975445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868631.975464:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939496576:0@lo:103: 00000100:00100000:0.0:1787868631.975483:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939496960 00000100:00100000:0.0:1787868631.975486:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939496960 00010000:00010000:0.0:1787868631.975498:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 18 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.975509:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497088 00000100:00100000:0.0:1787868631.975511:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497088 00010000:00010000:0.0:1787868631.975519:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 19 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.975530:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868631.975536:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3638:x1874715939496960:12345-0@lo:103: 00010000:00010000:0.0:1787868631.975544:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.975548:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 19 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975556:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 19 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975566:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2cf51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf4a expref: 19 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975574:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.975615:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:3638:x1874715939496960:12345-0@lo:103: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.975640:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868631.975652:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868631.975658:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:3639:x1874715939497088:12345-0@lo:103: 00010000:00010000:0.0:1787868631.975665:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.975669:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 17 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975678:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 17 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975687:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1aa00/0x2f11f4d3bde2cf43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cf3c expref: 17 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.975695:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.975721:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3639:x1874715939497088:12345-0@lo:103: Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.975726:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868631.975767:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939496960:0@lo:103: 00000100:00100000:0.0:1787868631.975786:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939497088:0@lo:103: 00000100:00100000:1.0:1787868631.976364:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497216:0@lo:103: 00000100:00100000:1.0:1787868631.976379:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939496832:0@lo:103: 00000100:00100000:0.0:1787868631.976415:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497344 00000100:00100000:0.0:1787868631.976419:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497344 00010000:00010000:0.0:1787868631.976439:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.976496:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868631.976503:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:3636:x1874715939497344:12345-0@lo:103: 00010000:00010000:0.0:1787868631.976510:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.976521:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.976530:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.976543:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2071c00/0x2f11f4d3bde2ceda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ced3 expref: 16 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.976553:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.976594:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3636:x1874715939497344:12345-0@lo:103: Request processed in 92us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.976609:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868631.976663:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497344:0@lo:103: 00000100:00100000:3.0:1787868631.992026:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868631.992761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472576 00000100:00100000:0.0:1787868631.992772:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472576 00010000:00010000:0.0:1787868631.992815:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 10 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.992855:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1787868631.992865:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918472576:12345-192.168.204.27@tcp:103: 00010000:00010000:0.0:1787868631.992880:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.992885:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 10 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.992909:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 10 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.992930:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.993001:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918472576:12345-192.168.204.27@tcp:103: Request processed in 129us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.993027:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1787868631.994682:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868631.994767:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472704 00000100:00100000:0.0:1787868631.994776:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472704 00010000:00010000:0.0:1787868631.994806:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 10 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868631.994844:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1787868631.994853:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918472704:12345-192.168.204.27@tcp:103: 00010000:00010000:0.0:1787868631.994865:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868631.994870:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 10 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994882:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 10 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994915:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994924:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994950:0:7463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994958:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994964:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.994996:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.995003:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20fe200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868631.995008:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.995015:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.995024:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868631.995034:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868631.995085:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918472704:12345-192.168.204.27@tcp:103: Request processed in 232us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868631.995092:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00010000:00010000:2.0:1787868631.998767:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee09 expref: 9 pid: 6506 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.998792:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939494912:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868631.998807:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2cff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee02 expref: 8 pid: 6507 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868631.998816:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874715939495040:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868631.998863:0:10327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.998872:0:10327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.998879:0:10327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868631.998885:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d03f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868632.182429:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868633.185383:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868633.377417:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939497600:0@lo:13: 00000100:00100000:0.0:1787868633.377505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.377584:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939498112:0@lo:400: 00000100:00100000:0.0:1787868633.377609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.377631:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787868633.377639:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939497472:0@lo:13: 00000100:00100000:0.0:1787868633.377670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.377690:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939497984:0@lo:400: 00000100:00100000:2.0:1787868633.377696:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939497856:0@lo:400: 00000100:00100000:0.0:1787868633.377720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.377740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.377817:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939498496:0@lo:400: 00000100:00100000:1.0:1787868633.377831:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497728:0@lo:400: 00000100:00100000:0.0:1787868633.377904:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939498624:0@lo:400: 00000100:00100000:0.0:1787868633.377931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.378830:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939499136:0@lo:400: 00000100:00100000:0.0:1787868633.378875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.378921:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498112 00000100:00100000:0.0:1787868633.378927:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498112 00000100:00100000:0.0:1787868633.378984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497856 00000100:00100000:0.0:1787868633.378987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497856 00000100:00100000:0.0:1787868633.379010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787868633.379132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939498112:12345-0@lo:400: 00000100:00100000:0.0:1787868633.379202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939498112:12345-0@lo:400: Request processed in 74us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.379209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787868633.379224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787868633.379230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939497856:12345-0@lo:400: 00000100:00100000:0.0:1787868633.379258:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939497856:12345-0@lo:400: Request processed in 28us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.379263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787868633.379280:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497600 00000100:00100000:0.0:1787868633.379284:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497600 00000100:00100000:0.0:1787868633.379310:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497472 00000100:00100000:0.0:1787868633.379313:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497472 00000100:00100000:0.0:1787868633.379326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787868633.379331:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939497600:12345-0@lo:13: 00002000:00000024:0.0:1787868633.379352:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868633.379384:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939497600:12345-0@lo:13: Request processed in 51us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.379390:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787868633.379411:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787868633.379417:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939497472:12345-0@lo:13: 00002000:00000024:0.0:1787868633.379426:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868633.380236:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939497472:12345-0@lo:13: Request processed in 818us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.380243:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787868633.380266:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498624 00000100:00100000:0.0:1787868633.380270:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498624 00000100:00100000:0.0:1787868633.380296:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499136 00000100:00100000:0.0:1787868633.380299:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499136 00000100:00100000:0.0:1787868633.380319:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868633.380326:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939498624:12345-0@lo:400: 00000100:00100000:0.0:1787868633.380356:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939498624:12345-0@lo:400: Request processed in 31us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.380363:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868633.380373:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868633.380379:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939499136:12345-0@lo:400: 00000100:00100000:0.0:1787868633.380426:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939499136:12345-0@lo:400: Request processed in 47us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.380443:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787868633.380463:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868633.380466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787868633.380495:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8780 x1874715939498624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868633.380510:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939498624:0@lo:400: 00010000:00080000:0.0:1787868633.381904:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8000 x1874715939499136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868633.381950:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939499136:0@lo:400: 00010000:00080000:0.0:1787868633.381975:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9a40 x1874715939497472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868633.382000:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939497472:0@lo:13: 00000100:00100000:0.0:1787868633.382299:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939498112:0@lo:400: 00010000:00080000:0.0:1787868633.382316:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e2d00 x1874715939497600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868633.382328:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939497600:0@lo:13: 00000100:00100000:0.0:1787868633.382417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497984 00000100:00100000:0.0:1787868633.382423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497984 00000100:00100000:0.0:1787868633.382624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787868633.382633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939497984:12345-0@lo:400: 00000100:00100000:0.0:1787868633.382697:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939497984:12345-0@lo:400: Request processed in 65us (4977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.382703:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787868633.382735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939497984:0@lo:400: 00000100:00100000:2.0:1787868633.387951:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939497856:0@lo:400: 00000100:00100000:2.0:1787868633.387968:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939498368:0@lo:400: 00000100:00100000:2.0:1787868633.388060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.388105:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939498880:0@lo:400: 00000100:00100000:2.0:1787868633.388127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.388190:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498368 00000100:00100000:2.0:1787868633.388197:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498368 00000100:00100000:2.0:1787868633.388256:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498880 00000100:00100000:2.0:1787868633.388259:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498880 00000100:00100000:2.0:1787868633.388282:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868633.388292:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939498368:12345-0@lo:400: 00000100:00100000:2.0:1787868633.388700:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939498368:12345-0@lo:400: Request processed in 410us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.388720:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868633.388740:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787868633.388747:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939498880:12345-0@lo:400: 00000100:00100000:2.0:1787868633.388778:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939498880:12345-0@lo:400: Request processed in 32us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.388783:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787868633.388810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868633.388814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787868633.388834:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8b40 x1874715939498880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868633.388847:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939498880:0@lo:400: 00000100:00100000:2.0:1787868633.388891:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939498368:0@lo:400: 00000100:00100000:3.0:1787868633.390293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.391275:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498496 00000100:00100000:3.0:1787868633.391284:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498496 00000100:00100000:3.0:1787868633.391361:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787868633.391371:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939498496:12345-0@lo:400: 00000100:00100000:3.0:1787868633.391429:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939498496:12345-0@lo:400: Request processed in 60us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.391436:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787868633.391459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868633.391486:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8f00 x1874715939498496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868633.391500:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939498496:0@lo:400: 00000100:00100000:3.0:1787868633.391509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939499008:0@lo:400: 00000100:00100000:3.0:1787868633.391856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.391906:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499008 00000100:00100000:3.0:1787868633.391920:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499008 00000100:00100000:3.0:1787868633.391953:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868633.391960:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939499008:12345-0@lo:400: 00000100:00100000:3.0:1787868633.392102:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939499008:12345-0@lo:400: Request processed in 142us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.392109:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787868633.392129:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787868633.392171:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9e00 x1874715939499008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868633.392181:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939499008:0@lo:400: 00000100:00100000:1.0:1787868633.395734:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.395804:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939498240:0@lo:400: 00000100:00100000:1.0:1787868633.396743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.396859:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939498752:0@lo:400: 00000100:00100000:1.0:1787868633.396896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.396927:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939499264:0@lo:41: 00000100:00100000:1.0:1787868633.397731:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.397792:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498752 00000100:00100000:0.0:1787868633.397800:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498752 00000100:00100000:0.0:1787868633.397885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787868633.397895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939498752:12345-0@lo:400: 00000100:00100000:3.0:1787868633.398539:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939497728 00000100:00100000:3.0:1787868633.398545:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939497728 00000100:00100000:3.0:1787868633.398580:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787868633.398588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3636:x1874715939497728:12345-0@lo:400: 00000100:00100000:3.0:1787868633.398628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:3636:x1874715939497728:12345-0@lo:400: Request processed in 41us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.398635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1787868633.398670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868633.399151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939498752:12345-0@lo:400: Request processed in 52us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.399173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868633.403581:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939497728:0@lo:400: 00000100:00100000:1.0:1787868633.403623:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939498752:0@lo:400: 00000100:00100000:2.0:1787868633.404442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939498240 00000100:00100000:2.0:1787868633.404450:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939498240 00000100:00100000:2.0:1787868633.404502:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499264 00000100:00100000:2.0:1787868633.404514:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499264 00000100:00100000:3.0:1787868633.404615:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787868633.404627:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939498240:12345-0@lo:400: 00000100:00100000:3.0:1787868633.404719:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939498240:12345-0@lo:400: Request processed in 94us (7975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.404727:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787868633.404859:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939498240:0@lo:400: 00000100:00100000:2.0:1787868633.405137:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787868633.405147:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939499264:12345-0@lo:41: 00000004:00000024:2.0:1787868633.405319:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868633.405372:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939499264:12345-0@lo:41: Request processed in 227us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.405379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787868633.405457:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939499264:0@lo:41: 10000000:01000000:0.0:1787868633.825298:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787868633.825306:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dabec41000 from 48 10000000:01000000:0.0:1787868633.825313:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868633.825362:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.825374:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.825399:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.825424:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499392:0@lo:101: 00000100:00100000:0.0:1787868633.825498:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.825576:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.825774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499392 00000100:00100000:3.0:1787868633.825781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499392 00000100:00100000:3.0:1787868633.825835:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787868633.825868:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+15:6510:x1874715939499392:12345-0@lo:101: 00010000:00010000:3.0:1787868633.825881:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868633.825895:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2d04d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d046 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.825918:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2d04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d046 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.825929:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2d04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d046 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.825938:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20ffc00, rc 0) 00000100:00100000:3.0:1787868633.826003:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939499392:12345-0@lo:101: Request processed in 147us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.826009:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787868633.826242:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499392:0@lo:101: 00010000:00010000:0.0:1787868633.826256:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.826266:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.826341:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499520:0@lo:501: 00000100:00100000:0.0:1787868633.826368:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.826404:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.827094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499520 00000100:00100000:3.0:1787868633.827100:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499520 00000100:00100000:3.0:1787868633.827139:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787868633.827147:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939499520:12345-0@lo:501: 00000100:00100000:3.0:1787868633.827321:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939499520:12345-0@lo:501: Request processed in 174us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.827328:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787868633.827495:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499520:0@lo:501: 00000100:00100000:0.0:1787868633.827521:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499648:0@lo:503: 00000100:00100000:0.0:1787868633.827560:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.827593:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.827643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499648 00000100:00100000:2.0:1787868633.827648:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499648 00000100:00100000:2.0:1787868633.827681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787868633.827689:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939499648:12345-0@lo:503: 00000100:00100000:2.0:1787868633.827772:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939499648:12345-0@lo:503: Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.827779:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787868633.828085:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939499648:0@lo:503: 00000100:00100000:2.0:1787868633.834485:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10344:1874715939499776:0@lo:502: 00000100:00100000:2.0:1787868633.834563:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.834616:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.834788:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499776 00000100:00100000:3.0:1787868633.834796:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499776 00000100:00100000:3.0:1787868633.834844:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787868633.834853:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:10344:x1874715939499776:12345-0@lo:502: 00000100:00100000:3.0:1787868633.834989:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:10344:x1874715939499776:12345-0@lo:502: Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.835004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787868633.835197:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10344:1874715939499776:0@lo:502: 00000100:00100000:1.0:1787868633.835236:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10344:1874715939499904:0@lo:502: 00000100:00100000:1.0:1787868633.835269:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.835296:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.835344:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939499904 00000100:00100000:3.0:1787868633.835348:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939499904 00000100:00100000:3.0:1787868633.835385:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787868633.835393:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:10344:x1874715939499904:12345-0@lo:502: 00000100:00100000:3.0:1787868633.835462:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:10344:x1874715939499904:12345-0@lo:502: Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.835468:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787868633.835561:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10344:1874715939499904:0@lo:502: 00000040:00080000:1.0:1787868633.835579:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787868633.835736:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787868633.835758:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868633.835768:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.835780:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868633.835790:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787868633.835792:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787868633.835794:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787868633.835816:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.835824:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.835832:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.835842:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500032:0@lo:101: 00000100:00100000:0.0:1787868633.835881:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.835900:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.835949:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500032 00000100:00100000:2.0:1787868633.835953:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500032 00000100:00100000:2.0:1787868633.835993:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787868633.836001:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+16:6510:x1874715939500032:12345-0@lo:101: 00010000:00010000:2.0:1787868633.836009:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868633.836020:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d05b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d054 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.836039:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d054 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.836061:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d054 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.836069:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870800, rc 0) 00000100:00100000:2.0:1787868633.839457:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500032:12345-0@lo:101: Request processed in 3446us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.839470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787868633.843193:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500032:0@lo:101: 00010000:00010000:1.0:1787868633.843225:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.843239:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.843325:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500160:0@lo:501: 00000100:00100000:1.0:1787868633.843393:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.843434:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.843518:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500160 00000100:00100000:0.0:1787868633.843525:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500160 00000100:00100000:0.0:1787868633.843579:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787868633.843589:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500160:12345-0@lo:501: 00000100:00100000:0.0:1787868633.843719:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500160:12345-0@lo:501: Request processed in 130us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.843742:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787868633.847727:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500160:0@lo:501: 00000100:00100000:1.0:1787868633.847789:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500288:0@lo:503: 00000100:00100000:1.0:1787868633.847875:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.847915:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.847992:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500288 00000100:00100000:3.0:1787868633.847999:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500288 00000100:00100000:3.0:1787868633.848053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787868633.848063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500288:12345-0@lo:503: 00000100:00100000:3.0:1787868633.848211:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500288:12345-0@lo:503: Request processed in 148us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.848218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787868633.848393:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500288:0@lo:503: 00000100:00100000:0.0:1787868633.849201:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10345:1874715939500416:0@lo:502: 00000100:00100000:0.0:1787868633.849245:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.849276:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.849364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500416 00000100:00100000:3.0:1787868633.849369:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500416 00000100:00100000:3.0:1787868633.849413:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787868633.849421:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:10345:x1874715939500416:12345-0@lo:502: 00000100:00100000:3.0:1787868633.849509:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:10345:x1874715939500416:12345-0@lo:502: Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.849516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787868633.849666:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10345:1874715939500416:0@lo:502: 00000020:01000000:0.0:1787868633.849689:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868633.849698:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868633.849701:0:10345:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787868633.849705:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787868633.849724:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10345:1874715939500544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.849757:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.849784:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.849836:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500544 00000100:00100000:3.0:1787868633.849840:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500544 00000100:00100000:3.0:1787868633.849875:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787868633.849882:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:10345:x1874715939500544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868633.850266:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:10345:x1874715939500544:12345-0@lo:502:llog_process_th.0 Request processed in 383us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.850274:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787868633.854144:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10345:1874715939500544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868633.854503:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868633.854514:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868633.854516:0:10345:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787868633.854521:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787868633.857448:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787868633.857495:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787868633.857506:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.857519:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868633.857531:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787868633.857534:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab5b24800 from 48 10000000:01000000:1.0:1787868633.857537:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787868633.857573:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.857580:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.857591:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.857616:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.857680:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.857717:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.857811:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500672 00000100:00100000:2.0:1787868633.857818:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500672 00000100:00100000:2.0:1787868633.857873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787868633.857882:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+17:6510:x1874715939500672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868633.857894:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868633.857906:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2d069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d062 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.857927:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2d069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d062 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.857937:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2d069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d062 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.857946:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871e00, rc 0) 00000100:00100000:2.0:1787868633.858002:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939500672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.858009:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787868633.859686:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868633.859710:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.859722:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.859805:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.859849:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.859892:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.859973:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500800 00000100:00100000:3.0:1787868633.859979:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500800 00000100:00100000:3.0:1787868633.860028:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787868633.860038:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939500800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.860197:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939500800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.860205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787868633.860435:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.860463:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.860536:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.860553:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.860597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939500928 00000100:00100000:2.0:1787868633.860601:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939500928 00000100:00100000:2.0:1787868633.860640:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787868633.860647:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939500928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.860734:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939500928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.860741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787868633.860989:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939500928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.861447:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10346:1874715939501056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.861484:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.861512:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.861558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501056 00000100:00100000:2.0:1787868633.861562:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501056 00000100:00100000:2.0:1787868633.861593:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787868633.861600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:10346:x1874715939501056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.861688:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:10346:x1874715939501056:12345-0@lo:502:llog_process_th.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.861695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787868633.861814:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10346:1874715939501056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.861846:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10346:1874715939501184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.861885:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.861903:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.861935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501184 00000100:00100000:0.0:1787868633.861939:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501184 00000100:00100000:0.0:1787868633.861967:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787868633.861973:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:10346:x1874715939501184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.862045:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:10346:x1874715939501184:12345-0@lo:502:llog_process_th.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.862052:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787868633.862148:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10346:1874715939501184:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787868633.862189:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787868633.862343:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787868633.862367:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868633.862387:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.862397:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868633.862406:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787868633.862409:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787868633.862412:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787868633.862431:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.862439:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.862447:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.862458:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.862482:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.862506:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.862565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501312 00000100:00100000:1.0:1787868633.862568:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501312 00000100:00100000:1.0:1787868633.862595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787868633.862602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+18:6510:x1874715939501312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868633.862610:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868633.862625:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2d077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d070 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.862642:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d070 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.862652:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d070 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.862660:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b600, rc 0) 00000100:00100000:1.0:1787868633.862684:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.862690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787868633.862742:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868633.862752:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.862761:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.862797:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.862825:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.862843:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.862929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501440 00000100:00100000:1.0:1787868633.862933:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501440 00000100:00100000:1.0:1787868633.862958:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787868633.862963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.863055:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.863062:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787868633.863188:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.863213:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.863242:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.863253:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.863303:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501568 00000100:00100000:2.0:1787868633.863307:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501568 00000100:00100000:2.0:1787868633.863323:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787868633.863328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.863403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.863409:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787868633.863508:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.867365:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10347:1874715939501696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868633.867454:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.867496:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.867590:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501696 00000100:00100000:2.0:1787868633.867597:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501696 00000100:00100000:2.0:1787868633.867645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787868633.867654:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:10347:x1874715939501696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.867773:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:10347:x1874715939501696:12345-0@lo:502:llog_process_th.0 Request processed in 119us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.867780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787868633.868270:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10347:1874715939501696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868633.868296:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868633.868305:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868633.868308:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787868633.868312:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787868633.868332:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10347:1874715939501824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868633.868372:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.868406:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.868482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501824 00000100:00100000:1.0:1787868633.868486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501824 00000100:00100000:1.0:1787868633.868513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787868633.868521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:10347:x1874715939501824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.868606:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:10347:x1874715939501824:12345-0@lo:502:llog_process_th.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.868613:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787868633.868719:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10347:1874715939501824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868633.868737:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868633.868742:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868633.868743:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787868633.868747:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787868633.868891:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787868633.868911:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787868633.868921:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.868931:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868633.868951:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787868633.868954:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daaf704800 from 48 10000000:01000000:0.0:1787868633.868957:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868633.868991:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.869000:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.869009:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.869027:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.869055:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.869078:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.869264:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939501952 00000100:00100000:3.0:1787868633.869269:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939501952 00000100:00100000:3.0:1787868633.869298:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787868633.869305:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:6510:x1874715939501952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868633.869313:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868633.869325:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2d085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d07e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.869343:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d07e expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.869352:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d07e expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.869361:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20ffe00, rc 0) 00000100:00100000:3.0:1787868633.869403:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939501952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.869409:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787868633.869559:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939501952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868633.869572:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.869593:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.869639:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.869663:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.869689:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.869732:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502080 00000100:00100000:2.0:1787868633.869736:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502080 00000100:00100000:2.0:1787868633.869770:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787868633.869778:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939502080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.869893:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939502080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.869900:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787868633.869967:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.870003:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.870037:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.870060:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.870239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502208 00000100:00100000:1.0:1787868633.870250:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502208 00000100:00100000:1.0:1787868633.870278:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787868633.870284:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939502208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.870356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939502208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.870362:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787868633.870711:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.874969:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10348:1874715939502336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.875062:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.875104:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.885886:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502336 00000100:00100000:1.0:1787868633.885903:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502336 00000100:00100000:1.0:1787868633.885990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787868633.886002:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:10348:x1874715939502336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.886206:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:10348:x1874715939502336:12345-0@lo:502:llog_process_th.0 Request processed in 206us (11143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.886214:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787868633.886487:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10348:1874715939502336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.886548:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10348:1874715939502464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.886591:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.886633:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.886802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502464 00000100:00100000:0.0:1787868633.886807:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502464 00000100:00100000:0.0:1787868633.886842:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787868633.886850:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:10348:x1874715939502464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.886947:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:10348:x1874715939502464:12345-0@lo:502:llog_process_th.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.886954:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787868633.887195:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10348:1874715939502464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787868633.887214:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787868633.887439:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787868633.887457:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868633.887467:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.887484:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868633.887494:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787868633.887496:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787868633.887499:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787868633.887521:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.887528:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.887535:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.887547:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.887575:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.887595:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.887683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502592 00000100:00100000:2.0:1787868633.887687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502592 00000100:00100000:2.0:1787868633.887719:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787868633.887727:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939502592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868633.887735:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868633.887747:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2d093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d08c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.887767:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d08c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.887777:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d08c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.887796:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871600, rc 0) 00000100:00100000:2.0:1787868633.887835:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939502592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.887841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787868633.887908:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868633.887921:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.887951:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868633.888008:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.888035:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.888056:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.888228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502720 00000100:00100000:2.0:1787868633.888232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502720 00000100:00100000:2.0:1787868633.888250:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787868633.888257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939502720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.888365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939502720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.888371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787868633.888465:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.888490:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.888527:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.888548:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.888598:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502848 00000100:00100000:0.0:1787868633.888603:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502848 00000100:00100000:0.0:1787868633.888621:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787868633.888628:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939502848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.888706:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939502848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.888712:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787868633.888776:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939502848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.892629:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10349:1874715939502976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.892719:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.892767:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.892810:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939502976 00000100:00100000:0.0:1787868633.892817:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939502976 00000100:00100000:0.0:1787868633.892869:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787868633.892884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10349:x1874715939502976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.893021:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10349:x1874715939502976:12345-0@lo:502:llog_process_th.0 Request processed in 137us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.893028:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787868633.893105:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10349:1874715939502976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868633.893130:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868633.893138:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868633.893141:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787868633.893146:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787868633.893407:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10349:1874715939503104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868633.893441:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.893455:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.893639:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868633.893650:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939503232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868633.893681:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.893714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503104 00000100:00100000:1.0:1787868633.893718:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503104 00000100:00100000:1.0:1787868633.893742:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787868633.893749:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10349:x1874715939503104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.893831:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10349:x1874715939503104:12345-0@lo:502:llog_process_th.0 Request processed in 81us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.893838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787868633.893867:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10349:1874715939503104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868633.893886:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868633.893902:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868633.893904:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787868633.893907:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1787868633.894072:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1787868633.894090:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787868633.894100:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.894116:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868633.894127:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787868633.894129:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05d8800 from 48 10000000:01000000:1.0:1787868633.894132:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787868633.894182:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.894191:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.894201:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.894215:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.894239:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503232 00000100:00100000:1.0:1787868633.894241:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.894242:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503232 00000100:00100000:0.0:1787868633.894269:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787868633.894272:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.894276:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939503232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868633.894282:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503360 00000100:00100000:1.0:1787868633.894284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503360 00002000:00000024:0.0:1787868633.894295:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868633.894300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787868633.894305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939503360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868633.894312:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868633.894323:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2d0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d09a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.894329:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939503232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.894335:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787868633.894343:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2d0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d09a expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.894362:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939503488:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787868633.894376:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2d0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d09a expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.894384:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ba00, rc 0) 00000100:00100000:0.0:1787868633.894403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.894412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939503360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.894417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787868633.894438:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503488 00000100:00100000:1.0:1787868633.894441:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.894441:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503488 00010000:00010000:1.0:1787868633.894452:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.894461:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.894464:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787868633.894470:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939503488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868633.894490:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868633.894502:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.894522:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.894523:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939503488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.894530:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787868633.894533:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.894542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503616 00000100:00100000:1.0:1787868633.894544:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503616 00010000:00080000:0.0:1787868633.894557:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882dd2c0 x1874715939503232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868633.894559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787868633.894564:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939503616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.894572:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939503232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868633.894608:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939503488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868633.894814:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939503616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.894821:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787868633.895339:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939503744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868633.895384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868633.895446:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503744 00000100:00100000:3.0:1787868633.895450:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503744 00000100:00100000:3.0:1787868633.895483:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787868633.895491:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939503744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868633.895502:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868633.895548:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939503744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.895554:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787868633.895625:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008780 x1874715939503744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868633.895639:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939503744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868633.897109:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.897152:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.897222:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.897252:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.898054:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939503872 00000100:00100000:1.0:1787868633.898062:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939503872 00000100:00100000:1.0:1787868633.898109:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787868633.898118:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939503872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.898268:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939503872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.898275:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787868633.899094:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939503872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.904666:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10350:1874715939504000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.904745:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.904789:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868633.904962:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504000 00000100:00100000:1.0:1787868633.904970:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504000 00000100:00100000:1.0:1787868633.905022:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787868633.905032:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10350:x1874715939504000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868633.905190:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10350:x1874715939504000:12345-0@lo:502:llog_process_th.0 Request processed in 159us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868633.905197:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787868633.905397:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10350:1874715939504000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.905440:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10350:1874715939504128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.905471:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868633.905491:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868633.905728:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504128 00000100:00100000:0.0:1787868633.905733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504128 00000100:00100000:0.0:1787868633.905765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787868633.905773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10350:x1874715939504128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.905846:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10350:x1874715939504128:12345-0@lo:502:llog_process_th.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868633.905863:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787868633.905932:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10350:1874715939504128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787868633.905964:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787868633.906206:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787868633.906235:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868633.906244:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.906266:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868633.906277:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787868633.906285:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787868633.906288:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787868633.906312:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.906320:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.906328:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.906342:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.906379:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.906404:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.907185:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504256 00000100:00100000:2.0:1787868633.907191:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504256 00000100:00100000:2.0:1787868633.907229:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787868633.907237:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939504256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868633.907256:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868633.907270:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2d0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d0a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.907292:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2d0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0a8 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.907303:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2d0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0a8 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868633.907311:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871c00, rc 0) 00000100:00100000:2.0:1787868633.907358:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.907365:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787868633.908633:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868633.908652:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868633.908663:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868633.908721:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.908755:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.908786:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.908812:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504384 00000100:00100000:3.0:1787868633.908818:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504384 00000100:00100000:3.0:1787868633.908851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787868633.908869:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868633.908995:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.909003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787868633.909043:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.909072:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.909116:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.909140:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.909489:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504512 00000100:00100000:2.0:1787868633.909495:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504512 00000100:00100000:2.0:1787868633.909521:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787868633.909529:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.909637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.909644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787868633.909771:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868633.912227:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10351:1874715939504640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.912302:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.912341:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.913068:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504640 00000100:00100000:3.0:1787868633.913078:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504640 00000100:00100000:3.0:1787868633.913130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787868633.913138:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10351:x1874715939504640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868633.913296:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10351:x1874715939504640:12345-0@lo:502:llog_process_th.0 Request processed in 158us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.913304:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787868633.915199:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10351:1874715939504640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868633.915412:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868633.915422:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868633.915425:0:10351:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787868633.915431:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787868633.915465:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10351:1874715939504768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868633.915523:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868633.915562:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.915707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504768 00000100:00100000:2.0:1787868633.915714:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504768 00000100:00100000:2.0:1787868633.915755:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787868633.915763:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10351:x1874715939504768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868633.915879:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10351:x1874715939504768:12345-0@lo:502:llog_process_th.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868633.915886:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787868633.916337:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10351:1874715939504768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868633.916366:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868633.916371:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868633.916373:0:10351:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787868633.916377:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787868633.916576:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787868633.916602:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787868633.916612:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.916635:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868633.916645:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787868633.916647:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93daae688000 from 1 10000000:01000000:1.0:1787868633.916650:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787868633.916673:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.916681:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.916689:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.916702:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.916732:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.916756:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868633.917145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939504896 00000100:00100000:3.0:1787868633.917151:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939504896 00000100:00100000:3.0:1787868633.917198:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787868633.917206:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939504896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868633.917216:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868633.917235:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20fe400/0x2f11f4d3bde2d0bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d0b6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.917258:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20fe400/0x2f11f4d3bde2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0b6 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.917269:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20fe400/0x2f11f4d3bde2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0b6 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868633.917277:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20fe400, rc 0) 00000100:00100000:3.0:1787868633.917318:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939504896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868633.917324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787868633.919328:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939504896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868633.919362:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.919374:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868633.919447:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939505024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868633.919489:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868633.919537:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868633.920045:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505024 00000100:00100000:2.0:1787868633.920052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505024 00000100:00100000:2.0:1787868633.920087:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787868633.920094:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939505024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868633.920192:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939505024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787868633.920199:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787868633.920649:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939505024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787868633.920691:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787868633.920704:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868633.920714:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868634.209322:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868634.522643:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868634.522757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472832 00000100:00100000:3.0:1787868634.522768:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472832 00000100:00100000:3.0:1787868634.522831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:3.0:1787868634.522853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:6180:x1874715918472832:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1787868634.522870:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868634.522890:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d0c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee79 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868634.522922:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee79 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868634.522952:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee79 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868634.522962:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac20fe200, rc 0) 00000100:00100000:3.0:1787868634.523026:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918472832:12345-192.168.204.27@tcp:101: Request processed in 185us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868634.523046:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:3.0:1787868634.527225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868634.528528:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918472960 00000100:00100000:0.0:1787868634.528541:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918472960 00000100:00100000:0.0:1787868634.528607:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:0.0:1787868634.528617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918472960:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1787868634.528781:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918472960:12345-192.168.204.27@tcp:501: Request processed in 164us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868634.528788:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:1.0:1787868634.543243:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868634.543333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473088 00000100:00100000:2.0:1787868634.543342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473088 00000100:00100000:2.0:1787868634.543405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:2.0:1787868634.543417:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918473088:12345-192.168.204.27@tcp:503: 00000100:00100000:2.0:1787868634.543558:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918473088:12345-192.168.204.27@tcp:503: Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868634.543576:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:1.0:1787868634.561987:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868634.571556:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473216 00000100:00100000:3.0:1787868634.574623:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473216 00000100:00100000:3.0:1787868634.574716:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:3.0:1787868634.574727:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6668:x1874715918473216:12345-192.168.204.27@tcp:502: 00000100:00100000:3.0:1787868634.574942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6668:x1874715918473216:12345-192.168.204.27@tcp:502: Request processed in 216us (12964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868634.574950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:3.0:1787868634.579214:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868634.579305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473344 00000100:00100000:0.0:1787868634.579314:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473344 00000100:00100000:0.0:1787868634.579367:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:0.0:1787868634.579386:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6668:x1874715918473344:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868634.579536:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6668:x1874715918473344:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868634.579545:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:1.0:1787868634.592456:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868634.593212:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473472 00000100:00100000:2.0:1787868634.593223:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473472 00000100:00100000:2.0:1787868634.593283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:2.0:1787868634.593294:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918473472:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868634.593311:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868634.593331:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2d0cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee80 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868634.593360:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2d0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee80 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868634.593401:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2d0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee80 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868634.593411:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871400, rc 0) 00000100:00100000:2.0:1787868634.593466:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918473472:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868634.593474:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:1.0:1787868634.604133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868634.604264:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473600 00000100:00100000:0.0:1787868634.604275:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473600 00000100:00100000:0.0:1787868634.604335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:0.0:1787868634.604346:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918473600:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868634.604474:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918473600:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 130us (351us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787868634.604482:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00010000:00010000:1.0:1787868635.235844:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868636.257442:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787868636.570299:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6a9f21d0 20000000:00000080:1.0:1787868636.570317:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d988205400 uarg=0000000000000000 20000000:01000000:1.0:1787868636.570358:0:10388:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787868636.570363:0:10388:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787868636.570367:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787868636.570720:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787868636.570865:0:10388:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787868636.576906:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787868636.576949:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787868636.577053:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787868636.577070:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787868636.577089:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577108:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577130:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577136:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577143:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577152:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577199:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577239:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577324:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 9 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.577341:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505152:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868636.577580:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577590:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 23 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.577602:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505280:0@lo:104: 00000100:00100000:1.0:1787868636.577652:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868636.577687:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577696:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 23 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.577705:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505408:0@lo:104: 00000100:00100000:1.0:1787868636.577726:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868636.577773:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577783:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 23 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.577791:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505536:0@lo:104: 00010000:00010000:1.0:1787868636.577831:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868636.577843:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 23 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.577851:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505664:0@lo:104: 00000100:00100000:1.0:1787868636.577867:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868636.577970:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787868636.577988:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868636.578002:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868636.578010:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505280 00000100:00100000:3.0:1787868636.578016:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505280 00000100:00100000:3.0:1787868636.578052:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505408 00000100:00100000:3.0:1787868636.578054:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505408 00000100:00100000:3.0:1787868636.578063:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505536 00000100:00100000:3.0:1787868636.578065:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505536 00000100:00100000:3.0:1787868636.578073:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505664 00000100:00100000:3.0:1787868636.578075:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505664 00000100:00100000:3.0:1787868636.578086:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868636.578093:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:10388:x1874715939505280:12345-0@lo:104: 00010000:00010000:3.0:1787868636.578106:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578198:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787868636.578209:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:10388:x1874715939505280:12345-0@lo:104: Request processed in 116us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.578217:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868636.578234:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787868636.578240:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10388:x1874715939505408:12345-0@lo:104: 00010000:00010000:3.0:1787868636.578247:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578278:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787868636.578283:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:10388:x1874715939505408:12345-0@lo:104: Request processed in 44us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.578289:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787868636.578316:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787868636.578322:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10388:x1874715939505536:12345-0@lo:104: 00010000:00010000:3.0:1787868636.578330:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578355:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787868636.578360:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:10388:x1874715939505536:12345-0@lo:104: Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.578366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787868636.578375:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787868636.578380:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10388:x1874715939505664:12345-0@lo:104: 00010000:00010000:3.0:1787868636.578388:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578408:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787868636.578417:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:10388:x1874715939505664:12345-0@lo:104: Request processed in 37us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.578423:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787868636.578437:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787868636.578444:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578452:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868636.578455:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578463:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868636.578472:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868636.578478:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868636.578502:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578509:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868636.578524:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578531:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031a00/0x2f11f4d3bde2ceef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cef6 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578545:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787868636.578548:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578564:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868636.578579:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578586:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868636.578593:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868636.578598:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868636.578611:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578617:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868636.578625:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578632:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2a00/0x2f11f4d3bde2cdc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cdd0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578639:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868636.578642:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578648:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868636.578651:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578666:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868636.578673:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868636.578678:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868636.578688:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578694:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868636.578704:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578710:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80030800/0x2f11f4d3bde2cd75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578718:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868636.578722:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578727:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868636.578730:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578736:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868636.578743:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868636.578753:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868636.578763:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578769:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868636.578774:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578781:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2cd67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2cd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.578792:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868636.578794:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868636.578795:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868636.578812:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868636.578823:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939505920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868636.578850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868636.578875:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868636.578880:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939505792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868636.578896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868636.578916:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505920 00000100:00100000:3.0:1787868636.578919:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505920 00010000:00010000:3.0:1787868636.578937:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 24 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868636.579015:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939505792 00000100:00100000:3.0:1787868636.579018:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939505792 00010000:00010000:3.0:1787868636.579033:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 25 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868636.579061:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787868636.579067:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3637:x1874715939505920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868636.579076:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868636.579081:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 25 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.579090:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 25 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.579106:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868636.579129:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3637:x1874715939505920:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.579135:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787868636.579146:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787868636.579151:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939505792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868636.579179:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868636.579183:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 24 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.579191:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 24 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.579200:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868636.579217:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939505792:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.579223:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787868636.579253:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939505792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868636.579267:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939505920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868636.579549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939506048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868636.579587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868636.579617:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868636.579622:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939506176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868636.579641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868636.579662:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506048 00000100:00100000:2.0:1787868636.579666:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506048 00010000:00010000:2.0:1787868636.579680:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 24 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868636.579692:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506176 00000100:00100000:2.0:1787868636.579694:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506176 00010000:00010000:2.0:1787868636.579702:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 25 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868636.579712:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868636.579717:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3638:x1874715939506048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868636.579724:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868636.579731:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 25 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.579745:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 25 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.579754:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868636.579779:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3638:x1874715939506048:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868636.579785:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868636.579796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787868636.579801:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939506176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868636.579821:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868636.579826:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 24 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.579833:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 24 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.579841:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868636.579859:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939506176:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868636.579864:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787868636.579901:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939506176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868636.579908:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939506048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868636.580123:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868636.580232:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2cef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ceef expref: 23 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.580244:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505280:0@lo:104: 00010000:00010000:1.0:1787868636.580253:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2cdd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cdc9 expref: 22 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.580272:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505408:0@lo:104: 00010000:00010000:1.0:1787868636.580281:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2cd7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd75 expref: 21 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.580288:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505536:0@lo:104: 00010000:00010000:1.0:1787868636.580296:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2cd6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2cd67 expref: 20 pid: 6507 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.580303:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505664:0@lo:104: 00000100:00100000:3.0:1787868636.587779:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874715939505152:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868636.587888:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.589701:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868636.590558:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473728 00000100:00100000:2.0:1787868636.590569:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473728 00010000:00010000:2.0:1787868636.590614:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868636.590665:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1787868636.590674:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2404:x1874715918473728:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868636.590689:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868636.590695:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.590708:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.590727:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d00e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee41 expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591085:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591095:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591112:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591120:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591127:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591135:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591150:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868636.591176:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591186:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591203:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868636.591214:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868636.591273:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:2404:x1874715918473728:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 599us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868636.591281:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00010000:00010000:3.0:1787868636.591655:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.591666:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868636.591674:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d0d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868636.903512:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868636.903559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868636.903592:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868636.903646:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868636.903673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473984 00000100:00100000:2.0:1787868636.903683:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473984 00000100:00100000:2.0:1787868636.903750:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918473856 00000100:00100000:2.0:1787868636.903754:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918473856 00000100:00100000:2.0:1787868636.903776:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:2.0:1787868636.903785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918473984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868636.904129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1787868636.904130:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918473984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 345us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.904138:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918473856:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868636.904138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1787868636.904208:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918473856:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 71us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868636.904218:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00080000:1.0:1787868636.904240:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868636.904244:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868636.904618:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474240 00000100:00100000:0.0:1787868636.904635:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474240 00000100:00100000:0.0:1787868636.904685:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474112 00000100:00100000:0.0:1787868636.904688:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474112 00000100:00100000:0.0:1787868636.904723:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868636.904731:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918474240:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868636.904770:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918474240:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868636.904778:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868636.904790:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868636.904809:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918474112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868636.904834:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918474112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868636.904840:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00080000:1.0:1787868636.907833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868636.907844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787868637.281416:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868638.312081:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787868638.434337:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787868638.434345:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dabec41000 from 4 10000000:01000000:2.0:1787868638.434350:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868638.434400:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.434425:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.434438:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868638.434480:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.434549:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.434599:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.435629:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506304 00000100:00100000:0.0:1787868638.435639:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506304 00000100:00100000:0.0:1787868638.435697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787868638.436547:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939506304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868638.436569:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868638.436591:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d0d9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.436620:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.436632:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.436641:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d3e00, rc 0) 00000100:00100000:2.0:1787868638.437347:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868638.437368:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.437378:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868638.437575:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 993us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.437850:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.437930:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787868638.440659:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.440720:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868638.442028:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506432 00000100:00100000:1.0:1787868638.442043:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506432 00000100:00100000:1.0:1787868638.442106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787868638.442117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868638.442309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868638.442316:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787868638.442515:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.442561:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.442610:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.442645:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.442692:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506560 00000100:00100000:0.0:1787868638.442696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506560 00000100:00100000:0.0:1787868638.442730:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787868638.442737:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.442841:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.442847:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787868638.443192:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.446848:0:10457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10457:1874715939506688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868638.447024:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.447067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506688 00000100:00100000:0.0:1787868638.447075:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506688 00000100:00100000:0.0:1787868638.447122:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787868638.447130:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10457:x1874715939506688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868638.447279:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10457:x1874715939506688:12345-0@lo:502:llog_process_th.0 Request processed in 149us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.447287:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787868638.447350:0:10457:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.447372:0:10457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10457:1874715939506688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868638.447401:0:10457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868638.447411:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868638.447414:0:10457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787868638.447426:0:10457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dabec41000 00000020:00000080:0.0:1787868638.447429:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787868638.448459:0:10457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10457:1874715939506816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868638.448523:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868638.448556:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506816 00000100:00100000:1.0:1787868638.448562:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506816 00000100:00100000:1.0:1787868638.448599:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787868638.448606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10457:x1874715939506816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868638.448705:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:10457:x1874715939506816:12345-0@lo:502:llog_process_th.0 Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868638.448712:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787868638.448756:0:10457:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180900 going to sleep for 11 seconds 00000100:00100000:1.0:1787868638.448785:0:10457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10457:1874715939506816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787868638.448808:0:10457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868638.448815:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868638.448817:0:10457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787868638.448822:0:10457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787868638.449692:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787868638.449724:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787868638.449735:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.449748:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868638.449758:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787868638.449761:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab5b24800 from 4 10000000:01000000:2.0:1787868638.449764:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868638.449805:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.449814:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.449824:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868638.449842:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.449902:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.449931:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868638.449947:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939506944 00000100:00100000:2.0:1787868638.449951:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939506944 00000100:00100000:2.0:1787868638.449986:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787868638.449993:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939506944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868638.450003:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868638.450016:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d0e7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.450057:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.450071:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.450081:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868638.450123:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939506944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.450129:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787868638.450190:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939506944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868638.450207:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868638.450218:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868638.450375:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.450405:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.450462:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.450499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507072 00000100:00100000:3.0:1787868638.450503:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507072 00000100:00100000:3.0:1787868638.450571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787868638.450580:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939507072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.450707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939507072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.450714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787868638.450762:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868638.450805:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868638.450844:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868638.450876:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.451249:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507200 00000100:00100000:3.0:1787868638.451254:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507200 00000100:00100000:3.0:1787868638.451282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787868638.451289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939507200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.451368:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939507200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.451374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787868638.452007:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.453321:0:10458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10458:1874715939507328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868638.453382:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.453422:0:10458:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.454079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507328 00000100:00100000:3.0:1787868638.454086:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507328 00000100:00100000:3.0:1787868638.454119:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787868638.454127:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10458:x1874715939507328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.454378:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10458:x1874715939507328:12345-0@lo:502:llog_process_th.0 Request processed in 250us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.454386:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787868638.454579:0:10458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10458:1874715939507328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787868638.454611:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868638.454620:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868638.454622:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787868638.454628:0:10458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab5b24800 00000020:00000080:2.0:1787868638.454631:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787868638.454697:0:10458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10458:1874715939507456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868638.454734:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.454777:0:10458:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.455098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507456 00000100:00100000:3.0:1787868638.455104:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507456 00000100:00100000:3.0:1787868638.455144:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787868638.455152:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10458:x1874715939507456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.455638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:10458:x1874715939507456:12345-0@lo:502:llog_process_th.0 Request processed in 486us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.455646:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787868638.457190:0:10458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10458:1874715939507456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787868638.457254:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868638.457262:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868638.457264:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787868638.457269:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787868638.457891:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787868638.457913:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868638.457925:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.457936:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868638.457946:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868638.457948:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daaf704800 from 4 10000000:01000000:0.0:1787868638.457951:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868638.457989:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.457997:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.458006:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868638.458036:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.458093:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.458135:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868638.458363:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507584 00000100:00100000:2.0:1787868638.458370:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507584 00000100:00100000:2.0:1787868638.458417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787868638.458426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939507584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868638.458437:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868638.458450:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d0f5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.458481:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.458491:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868638.458498:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870e00, rc 0) 00000100:00100000:2.0:1787868638.458683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939507584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.458690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787868638.458782:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868638.458797:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.458805:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868638.458859:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.458951:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.459011:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868638.462282:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507712 00000100:00100000:2.0:1787868638.462295:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507712 00000100:00100000:2.0:1787868638.462691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787868638.462704:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939507712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868638.462999:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939507712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.463017:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787868638.463103:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868638.463152:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868638.463237:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868638.474126:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.474625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507840 00000100:00100000:3.0:1787868638.474635:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507840 00000100:00100000:3.0:1787868638.474688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787868638.474698:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939507840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.475504:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939507840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 804us (12275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.475514:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787868638.481218:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939507840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.484786:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10461:1874715939507968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.484881:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868638.484926:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.485025:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939507968 00000100:00100000:0.0:1787868638.485032:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939507968 00000100:00100000:0.0:1787868638.485086:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787868638.485096:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10461:x1874715939507968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868638.485259:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10461:x1874715939507968:12345-0@lo:502:llog_process_th.0 Request processed in 163us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.485267:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787868638.485445:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10461:1874715939507968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868638.485489:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868638.485499:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868638.485501:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787868638.485508:0:10461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daaf704800 00000020:00000080:3.0:1787868638.485511:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787868638.485712:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10461:1874715939508096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.485748:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868638.485781:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.491374:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868638.491833:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508096 00000100:00100000:2.0:1787868638.491844:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508096 00000100:00100000:0.0:1787868638.492145:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474368 00000100:00100000:0.0:1787868638.492150:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474368 00000100:00100000:0.0:1787868638.492216:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:0.0:1787868638.492227:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:6180:x1874715918474368:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868638.492245:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868638.494556:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.494601:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.494614:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.494623:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d3000, rc 0) 00000100:00100000:0.0:1787868638.496028:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918474368:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 3798us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.496038:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:2.0:1787868638.496782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787868638.496797:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10461:x1874715939508096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868638.499714:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868638.499810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.500073:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:10461:x1874715939508096:12345-0@lo:502:llog_process_th.0 Request processed in 3281us (14323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.500084:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787868638.502171:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939508480:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.502236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.502291:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939508992:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.502320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.502340:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868638.502361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.502387:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868638.502395:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939508608:0@lo:400:kworker.0 00000100:00100000:0.0:1787868638.502684:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939508352:0@lo:400:kworker.0 00000100:00100000:0.0:1787868638.502724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508224 00000100:00100000:0.0:1787868638.502731:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508224 00000100:00100000:3.0:1787868638.502779:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10461:1874715939508096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868638.502794:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868638.502804:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939508224:12345-0@lo:13:osp-pre-0-0.0 00000020:01000000:3.0:1787868638.502826:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00002000:00000024:0.0:1787868638.502829:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000020:00000080:3.0:1787868638.502833:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868638.502835:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787868638.502839:0:10461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1787868638.502938:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939508224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.502946:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868638.502969:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508480 00000100:00100000:0.0:1787868638.502973:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508480 00000100:00100000:0.0:1787868638.503003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509504 00000100:00100000:0.0:1787868638.503006:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509504 00000100:00100000:0.0:1787868638.503030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787868638.503038:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939508480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868638.503074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939508480:12345-0@lo:400:kworker.0 Request processed in 38us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.503079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787868638.503090:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787868638.503095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868638.503115:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868638.503146:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.503151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787868638.503222:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00080000:0.0:1787868638.503242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868638.503258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474496 00000100:00100000:0.0:1787868638.503261:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474496 00000100:00100000:0.0:1787868638.503285:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00100000:0.0:1787868638.503291:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918474496:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.503408:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918474496:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 116us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.503415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00100000:2.0:1787868638.506682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.506785:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509120:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.506849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.506883:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509632:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.506907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.506943:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939508480:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.506962:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868638.507024:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508992 00000100:00100000:2.0:1787868638.507031:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508992 00000100:00100000:2.0:1787868638.507080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508608 00000100:00100000:2.0:1787868638.507083:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508608 00000100:00100000:2.0:1787868638.507102:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787868638.507110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507182:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939508992:12345-0@lo:400:kworker.0 Request processed in 72us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.507189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787868638.507208:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787868638.507214:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939508608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507422:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939508608:12345-0@lo:400:kworker.0 Request processed in 208us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.507429:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787868638.507559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507582:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939508864:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507618:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939509376:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507646:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939509888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868638.507667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507690:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787868638.507698:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939508736:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507737:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939509248:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507807:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939509760:0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.507828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.507852:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509120 00000100:00100000:2.0:1787868638.507856:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509120 00000100:00100000:2.0:1787868638.508565:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509632 00000100:00100000:2.0:1787868638.508571:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509632 00000100:00100000:2.0:1787868638.508584:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509760 00000100:00100000:2.0:1787868638.508587:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509760 00000100:00100000:2.0:1787868638.508601:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787868638.508608:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.508657:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509120:12345-0@lo:400:kworker.0 Request processed in 49us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.508663:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787868638.508677:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868638.508682:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.508724:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939509632:12345-0@lo:400:kworker.0 Request processed in 42us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.508730:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868638.508740:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868638.508746:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939509760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.508790:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939509760:12345-0@lo:400:kworker.0 Request processed in 44us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.508797:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787868638.508817:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868638.508821:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868638.508824:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868638.508845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508352 00000100:00100000:2.0:1787868638.508849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508352 00000100:00100000:0.0:1787868638.509249:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509888 00000100:00100000:0.0:1787868638.509254:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509888 00000100:00100000:0.0:1787868638.509293:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868638.509300:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939509888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868638.509316:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868638.509353:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939509888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.509367:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868638.509387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508736 00000100:00100000:0.0:1787868638.509392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508736 00000100:00100000:0.0:1787868638.509413:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787868638.509419:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868638.509451:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939508736:12345-0@lo:400:kworker.0 Request processed in 32us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.509458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787868638.509512:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e1a40 x1874715939508224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868638.509531:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939508224:0@lo:13:osp-pre-0-0.0 00000020:01000000:0.0:1787868638.509562:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787868638.509590:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868638.509600:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509616:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868638.509627:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868638.509629:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05d8800 from 4 10000000:01000000:0.0:1787868638.509632:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868638.509660:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509669:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509688:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868638.509709:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.509741:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.509777:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510016 00000100:00100000:0.0:1787868638.509781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510016 00000100:00100000:0.0:1787868638.509804:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787868638.509809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939510016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868638.509818:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868638.509831:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d10a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509854:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509878:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509886:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da813d2a00, rc 0) 00000100:00100000:0.0:1787868638.509910:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939510016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.509916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787868638.509950:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.509961:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868638.509973:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.509988:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868638.510036:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.510061:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.510078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510144 00000100:00100000:0.0:1787868638.510082:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510144 00000100:00100000:0.0:1787868638.510099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787868638.510104:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939510144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.510152:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939508864 00000100:00100000:3.0:1787868638.510190:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939508864 00000100:00100000:0.0:1787868638.510215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939510144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.512984:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509376 00000100:00100000:2.0:1787868638.512999:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509376 00000100:00100000:0.0:1787868638.513394:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787868638.513467:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.513498:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.513552:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.513622:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868638.513657:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510272 00000100:00100000:0.0:1787868638.513660:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510272 00000100:00100000:0.0:1787868638.513682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787868638.513690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939510272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.513817:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939510272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.513824:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787868638.513854:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868638.516263:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939510272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868638.518370:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939509248 00000100:00100000:3.0:1787868638.518383:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939509248 00000100:00100000:3.0:1787868638.518425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868638.518436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939508352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.518549:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939508352:12345-0@lo:400:kworker.0 Request processed in 115us (10989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.518557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787868638.520653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868638.520662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868638.520681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939508864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.520746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939508864:12345-0@lo:400:kworker.0 Request processed in 74us (13138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.520802:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474624 00000100:00100000:0.0:1787868638.520810:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474624 00000100:00100000:0.0:1787868638.520847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00100000:0.0:1787868638.520854:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918474624:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868638.520986:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6180:x1874715918474624:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 132us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.520993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00100000:1.0:1787868638.528101:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939508736:0@lo:400:kworker.0 00010000:00080000:1.0:1787868638.528123:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8780 x1874715939509760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868638.528133:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939509760:0@lo:400:kworker.0 00000100:00100000:1.0:1787868638.528147:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939508352:0@lo:400:kworker.0 00000100:00100000:1.0:1787868638.528178:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939508864:0@lo:400:kworker.0 00010000:00080000:1.0:1787868638.528191:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882da1c0 x1874715939509888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868638.528210:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939509888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868638.530103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787868638.530127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9873392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939509248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.531043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868638.531077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868638.531088:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868638.531505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9873392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939509248:12345-0@lo:400:kworker.0 Request processed in 1388us (23710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.531514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787868638.531756:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939508608:0@lo:400:kworker.0 00010000:00080000:1.0:1787868638.531786:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9680 x1874715939509120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868638.531798:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509120:0@lo:400:kworker.0 00010000:00080000:1.0:1787868638.531811:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8000 x1874715939509632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868638.531819:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939509632:0@lo:400:kworker.0 00010000:00080000:1.0:1787868638.531831:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8f00 x1874715939508992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868638.531839:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939508992:0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.532322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939509376:12345-0@lo:400:kworker.0 Request processed in 1234us (24681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.532330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787868638.532368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868638.532373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868638.534040:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868638.534088:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474752 00000100:00100000:0.0:1787868638.534100:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474752 00000100:00100000:0.0:1787868638.534174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 273 00000100:00100000:0.0:1787868638.534185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6732:x1874715918474752:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868638.534562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6732:x1874715918474752:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 379us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868638.534570:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 273 00000100:00100000:3.0:1787868638.536804:0:10463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10463:1874715939510400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.536915:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868638.536968:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939509248:0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.536995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510400 00010000:00080000:2.0:1787868638.536997:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9a40 x1874715939509376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868638.537006:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510400 00000100:00100000:2.0:1787868638.537012:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939509376:0@lo:400:kworker.0 00000100:00100000:3.0:1787868638.537075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787868638.537090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:10463:x1874715939510400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.537224:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:10463:x1874715939510400:12345-0@lo:502:llog_process_th.0 Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868638.537232:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787868638.537276:0:10463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787868638.537289:0:10463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10463:1874715939510400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868638.537312:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868638.537320:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868638.537323:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787868638.537329:0:10463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daa05d8800 00000020:00000080:3.0:1787868638.537331:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787868638.537396:0:10463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10463:1874715939510528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868638.537428:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868638.537446:0:10463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868638.538143:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510528 00000100:00100000:2.0:1787868638.538151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510528 00000100:00100000:2.0:1787868638.538435:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787868638.538445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:10463:x1874715939510528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868638.538893:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:10463:x1874715939510528:12345-0@lo:502:llog_process_th.0 Request processed in 448us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.538903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787868638.538959:0:10463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:10463:1874715939510528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868638.538994:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868638.539003:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868638.539005:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787868638.539009:0:10463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787868638.539960:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787868638.539987:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868638.539999:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868638.540011:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868638.540524:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868638.542727:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918474880 00000100:00100000:2.0:1787868638.542741:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918474880 00000100:00100000:2.0:1787868638.542818:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:2.0:1787868638.542831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6732:x1874715918474880:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787868638.543011:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:6732:x1874715918474880:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 182us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868638.543043:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:0.0:1787868639.010462:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939510656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868639.010569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868639.010672:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510656 00000100:00100000:0.0:1787868639.010696:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510656 00000100:00100000:0.0:1787868639.010772:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787868639.010783:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939510656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868639.010829:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868639.010886:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939510656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868639.010894:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787868639.010954:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939510656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868639.012643:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868639.013031:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939510912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868639.013139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868639.013173:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939510784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868639.013209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868639.013252:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510912 00000100:00100000:0.0:1787868639.013261:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510912 00000100:00100000:0.0:1787868639.013310:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939510784 00000100:00100000:0.0:1787868639.013313:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939510784 00000100:00100000:0.0:1787868639.013330:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868639.013339:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939510912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868639.013373:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868639.013433:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939510912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868639.013440:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868639.013458:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787868639.013465:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939510784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868639.013475:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868639.013504:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939510784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868639.013509:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787868639.013514:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0d2c0 x1874715939510912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787868639.013540:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b840 x1874715939510784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868639.013547:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939510912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868639.013553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939510784:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787868639.331452:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868640.356188:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868641.378094:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868642.011633:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868642.011723:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868642.011854:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475392 00000100:00100000:0.0:1787868642.011864:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475392 00000100:00100000:0.0:1787868642.011944:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1787868642.011955:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868642.012015:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868642.012102:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475136 00000100:00100000:1.0:1787868642.012107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475136 00000100:00100000:1.0:1787868642.012149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:1.0:1787868642.012176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918475136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868642.012263:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 310us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868642.012270:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00080000:0.0:1787868642.012290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868642.012294:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868642.012527:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868642.012560:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868642.012587:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475008 00000100:00100000:2.0:1787868642.012593:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475008 00000100:00100000:2.0:1787868642.012630:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:2.0:1787868642.012639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918475008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868642.012677:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918475008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868642.012684:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:2.0:1787868642.012726:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475520 00000100:00100000:2.0:1787868642.012729:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475520 00000100:00100000:0.0:1787868642.012902:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475264 00000100:00100000:0.0:1787868642.012907:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475264 00000100:00100000:0.0:1787868642.012943:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:0.0:1787868642.012950:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9873383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868642.012979:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9873383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868642.012986:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:2.0:1787868642.013050:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787868642.013058:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868642.013090:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918475520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868642.013096:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00080000:2.0:1787868642.013233:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868642.013237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868642.014191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918475136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2029us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868642.014201:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00010000:00010000:3.0:1787868642.401340:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868643.425457:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868643.617631:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939511424:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.617723:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.617775:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939511936:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618380:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939511040:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868643.618462:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939511552:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868643.618528:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939512064:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868643.618648:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939512576:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868643.618719:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511552 00000100:00100000:3.0:1787868643.618727:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511552 00000100:00100000:3.0:1787868643.618770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787868643.618779:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939511552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.618904:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939511552:12345-0@lo:400:kworker.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868643.618912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787868643.618933:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512064 00000100:00100000:3.0:1787868643.618937:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512064 00000100:00100000:3.0:1787868643.618969:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512576 00000100:00100000:3.0:1787868643.618972:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512576 00000100:00100000:3.0:1787868643.618988:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787868643.618994:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939512064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.619038:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939512064:12345-0@lo:400:kworker.0 Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868643.619044:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787868643.619056:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787868643.619063:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.619086:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939512576:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868643.619091:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787868643.619112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868643.619116:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868643.619149:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939511552:0@lo:400:kworker.0 00010000:00080000:3.0:1787868643.619311:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987338000 x1874715939512064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868643.619322:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939512064:0@lo:400:kworker.0 00010000:00080000:3.0:1787868643.619331:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988191a40 x1874715939512576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868643.619339:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939512576:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.619499:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.619523:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939512448:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.619549:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.619580:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939511168:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.619606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.619629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939511680:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.619649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.619945:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939512192:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.619970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.619991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868643.619998:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939511296:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.620037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939511808:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.620067:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939512320:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.620107:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511424 00000100:00100000:2.0:1787868643.620111:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511424 00000100:00100000:2.0:1787868643.620135:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511168 00000100:00100000:2.0:1787868643.620138:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511168 00000100:00100000:2.0:1787868643.620149:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511680 00000100:00100000:2.0:1787868643.620151:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511680 00000100:00100000:2.0:1787868643.620195:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512192 00000100:00100000:2.0:1787868643.620198:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512192 00000100:00100000:2.0:1787868643.620226:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511808 00000100:00100000:2.0:1787868643.620229:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511808 00000100:00100000:2.0:1787868643.620242:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512320 00000100:00100000:2.0:1787868643.620245:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512320 00000100:00100000:2.0:1787868643.620256:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787868643.620262:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939511424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620302:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939511424:12345-0@lo:400:kworker.0 Request processed in 41us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.620734:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787868643.620752:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787868643.620759:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939511168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620891:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939511168:12345-0@lo:400:kworker.0 Request processed in 133us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.620898:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787868643.620909:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787868643.620916:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939511680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620941:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939511680:12345-0@lo:400:kworker.0 Request processed in 26us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.620946:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787868643.620955:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787868643.620960:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.620980:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939512192:12345-0@lo:400:kworker.0 Request processed in 20us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.620985:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787868643.620995:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868643.621000:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939511808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.621036:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939511808:12345-0@lo:400:kworker.0 Request processed in 37us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.621043:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868643.621054:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787868643.621059:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939512320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.621080:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939512320:12345-0@lo:400:kworker.0 Request processed in 22us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.621085:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787868643.621103:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511040 00000100:00100000:2.0:1787868643.621107:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511040 00000100:00100000:2.0:1787868643.621132:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787868643.621137:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939511040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.621185:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939511040:12345-0@lo:400:kworker.0 Request processed in 48us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.621190:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787868643.621221:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511296 00000100:00100000:2.0:1787868643.621225:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511296 00000100:00100000:2.0:1787868643.621242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787868643.621248:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939511296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.621274:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939511296:12345-0@lo:400:kworker.0 Request processed in 26us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.621280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787868643.621410:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939511936 00000100:00100000:3.0:1787868643.621414:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939511936 00000100:00100000:3.0:1787868643.621442:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512448 00000100:00100000:3.0:1787868643.621445:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512448 00000100:00100000:3.0:1787868643.621461:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868643.621467:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939511936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.621512:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939511936:12345-0@lo:400:kworker.0 Request processed in 45us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868643.621527:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868643.621538:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868643.621551:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939512448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.621932:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939512448:12345-0@lo:400:kworker.0 Request processed in 27us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868643.621940:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787868643.621964:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868643.621968:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868643.621970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868643.621972:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868643.622420:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939511040:0@lo:400:kworker.0 00000100:00100000:1.0:1787868643.623473:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868643.623490:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939512704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868643.623543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868643.623582:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512704 00000100:00100000:1.0:1787868643.623588:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512704 00000100:00100000:1.0:1787868643.623623:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787868643.623630:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939512704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868643.623660:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868643.623715:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939512704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868643.623722:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868643.623967:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939511296:0@lo:400:kworker.0 00010000:00080000:2.0:1787868643.623997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987338b40 x1874715939511808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868643.624025:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939511808:0@lo:400:kworker.0 00010000:00080000:2.0:1787868643.624042:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9881903c0 x1874715939512320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868643.624050:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939512320:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.624061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939511168:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.624072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939511680:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.624082:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939512192:0@lo:400:kworker.0 00000100:00100000:2.0:1787868643.624136:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939511424:0@lo:400:kworker.0 00010000:00080000:2.0:1787868643.624148:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987339e00 x1874715939511936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868643.624173:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939511936:0@lo:400:kworker.0 00010000:00080000:2.0:1787868643.624185:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9881930c0 x1874715939512448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868643.624193:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939512448:0@lo:400:kworker.0 00000100:00100000:3.0:1787868643.626143:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868643.626254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.626414:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868643.626428:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939512832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868643.627253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868643.627310:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512960 00000100:00100000:2.0:1787868643.627318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512960 00000100:00100000:2.0:1787868643.627435:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939512832 00000100:00100000:2.0:1787868643.627439:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939512832 00000100:00100000:2.0:1787868643.627468:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868643.627477:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939512960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868643.627509:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868643.627550:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939512960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.627557:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868643.627573:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787868643.627579:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939512832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868643.627588:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868643.627622:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939512832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868643.627628:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787868643.627659:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0fc00 x1874715939512832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868643.627754:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939512832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868643.628538:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939512704:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787868643.629094:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e3480 x1874715939512960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868643.629291:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939512960:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787868643.821821:0:10688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787868644.130343:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868644.130369:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868644.130442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868644.130948:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868644.130960:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939513216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868644.130998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868644.131325:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513216 00000100:00100000:3.0:1787868644.131331:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513216 00000100:00100000:3.0:1787868644.131373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868644.131383:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939513216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868644.131413:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868644.131453:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939513216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868644.131467:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868644.131488:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939513344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868644.131513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868644.131553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939513216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868644.131579:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513088 00000100:00100000:3.0:1787868644.131582:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513088 00000100:00100000:3.0:1787868644.131600:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513344 00000100:00100000:3.0:1787868644.131602:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513344 00000100:00100000:3.0:1787868644.131612:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787868644.131618:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939513088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868644.132725:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868644.132860:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939513088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1239us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868644.132870:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787868644.132893:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787868644.132902:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939513344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868644.132912:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868644.132938:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939513344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868644.132944:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787868644.132979:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733a580 x1874715939513344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868644.132996:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939513344:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787868644.133030:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987338f00 x1874715939513088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868644.133055:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939513088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787868644.449318:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868645.474642:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868646.497750:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868647.151099:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868647.151145:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868647.151190:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868647.151213:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868647.151279:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868647.151308:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475904 00000100:00100000:2.0:1787868647.151316:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475904 00000100:00100000:2.0:1787868647.151368:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475776 00000100:00100000:2.0:1787868647.151371:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475776 00000100:00100000:2.0:1787868647.151404:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:2.0:1787868647.151415:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918475904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868647.151490:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918475904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868647.151498:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:2.0:1787868647.151515:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:2.0:1787868647.151521:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918475776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868647.151545:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918475776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868647.151551:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:2.0:1787868647.151573:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476032 00000100:00100000:2.0:1787868647.151576:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476032 00000100:00100000:2.0:1787868647.151612:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476160 00000100:00100000:2.0:1787868647.151615:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476160 00000100:00100000:2.0:1787868647.151637:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787868647.151643:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918476032:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1787868647.151667:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d023 00000100:00080000:2.0:1787868647.151675:0:8431:0:(import.c:65:import_set_state_nolock()) ffff93dab6f6a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868647.151718:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787868647.151832:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+2:2402:x1874715918476032:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 188us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868647.151838:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787868647.151850:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1787868647.151857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918476160:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1787868647.151869:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d02a 00000100:00080000:2.0:1787868647.151874:0:8431:0:(import.c:65:import_set_state_nolock()) ffff93d986310000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868647.151897:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787868647.151963:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+2:2402:x1874715918476160:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 106us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868647.151969:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00080000:2.0:1787868647.151986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868647.151990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868647.151992:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868647.151994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787868647.152132:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868647.152137:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868647.152303:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918475648 00000100:00100000:0.0:1787868647.152308:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918475648 00000100:00100000:0.0:1787868647.152341:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 279 00000100:00100000:0.0:1787868647.152347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918475648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868647.152452:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918475648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868647.152460:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 279 00010000:00010000:0.0:1787868647.527564:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868648.545407:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868648.737322:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868648.737356:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939513472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868648.737460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.737552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513472 00000100:00100000:1.0:1787868648.737563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513472 00000100:00100000:1.0:1787868648.737641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868648.737651:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939513472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868648.737699:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868648.737753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939513472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.737777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868648.737850:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939513472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868648.738247:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868648.738258:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939513600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868648.738294:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.738333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513600 00000100:00100000:1.0:1787868648.738337:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513600 00000100:00100000:1.0:1787868648.738380:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868648.738494:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939513600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868648.738522:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868648.738620:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939513600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.738628:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787868648.738648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868648.738995:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939513728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868648.739029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739052:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939514240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739094:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939514752:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739146:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868648.739152:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939513856:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739220:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939514368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739278:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939514880:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.739331:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514240 00000100:00100000:1.0:1787868648.739337:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514240 00000100:00100000:1.0:1787868648.739368:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868648.739376:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939514240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739641:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939514240:12345-0@lo:400:kworker.0 Request processed in 263us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.739649:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868648.739674:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514752 00000100:00100000:1.0:1787868648.739678:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514752 00000100:00100000:1.0:1787868648.739712:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514368 00000100:00100000:1.0:1787868648.739715:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514368 00000100:00100000:1.0:1787868648.739728:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514880 00000100:00100000:1.0:1787868648.739731:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514880 00000100:00100000:1.0:1787868648.739745:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787868648.739752:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939514752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739784:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939514752:12345-0@lo:400:kworker.0 Request processed in 32us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.739791:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787868648.739802:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787868648.739808:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939514368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.739832:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939514368:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.739838:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787868648.739862:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787868648.739877:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939514880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740017:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939514880:12345-0@lo:400:kworker.0 Request processed in 140us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.740024:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787868648.740047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513856 00000100:00100000:1.0:1787868648.740050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513856 00000100:00100000:1.0:1787868648.740080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787868648.740086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939513856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939513856:12345-0@lo:400:kworker.0 Request processed in 30us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.740123:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1787868648.740192:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868648.740197:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868648.740206:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513728 00000100:00100000:1.0:1787868648.740210:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513728 00000100:00100000:1.0:1787868648.740238:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868648.740245:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939513728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868648.740261:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868648.740292:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939513728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.740299:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787868648.740315:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868648.740332:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939514112:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740382:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939514624:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740453:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515136:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740501:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868648.740508:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939513984:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939514496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740612:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939515008:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868648.740663:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514624 00000100:00100000:1.0:1787868648.740667:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514624 00000100:00100000:1.0:1787868648.740693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515136 00000100:00100000:1.0:1787868648.740696:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515136 00000100:00100000:1.0:1787868648.740711:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515008 00000100:00100000:1.0:1787868648.740714:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515008 00000100:00100000:1.0:1787868648.740727:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868648.740733:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939514624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.740768:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939514624:12345-0@lo:400:kworker.0 Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.740775:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868648.741148:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868648.741182:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741214:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515136:12345-0@lo:400:kworker.0 Request processed in 60us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.741222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868648.741233:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868648.741239:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939515008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741275:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939515008:12345-0@lo:400:kworker.0 Request processed in 36us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.741281:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868648.741311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514112 00000100:00100000:1.0:1787868648.741316:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514112 00000100:00100000:1.0:1787868648.741340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939513984 00000100:00100000:1.0:1787868648.741342:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939513984 00000100:00100000:1.0:1787868648.741353:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939514496 00000100:00100000:1.0:1787868648.741355:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939514496 00000100:00100000:1.0:1787868648.741371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787868648.741377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939514112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939514112:12345-0@lo:400:kworker.0 Request processed in 98us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.741482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787868648.741495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787868648.741501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939513984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741527:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939513984:12345-0@lo:400:kworker.0 Request processed in 27us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.741533:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787868648.741543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787868648.741548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939514496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741588:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939514496:12345-0@lo:400:kworker.0 Request processed in 40us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868648.741594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787868648.741619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868648.741623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868648.741661:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939513856:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741693:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939514368:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.741708:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882da1c0 x1874715939514880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.741720:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939514880:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.741732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882de1c0 x1874715939513728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.741748:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939513728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868648.741760:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939514240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741772:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939514752:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.741817:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939513984:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.741827:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8000 x1874715939514496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.741970:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939514496:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.741985:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9e00 x1874715939515008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.741994:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939515008:0@lo:400:kworker.0 00000100:00100000:1.0:1787868648.742005:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939514112:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.742014:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d9680 x1874715939514624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.742021:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939514624:0@lo:400:kworker.0 00010000:00080000:1.0:1787868648.742040:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882dbc00 x1874715939515136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868648.742050:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515136:0@lo:400:kworker.0 00010000:00080000:3.0:1787868648.742188:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882dd2c0 x1874715939513600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868648.742204:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939513600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868649.257607:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939515264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868649.257717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868649.257828:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515264 00000100:00100000:3.0:1787868649.257838:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515264 00000100:00100000:3.0:1787868649.257897:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868649.257907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939515264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868649.257947:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868649.257996:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939515264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868649.258004:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787868649.258052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987338f00 x1874715939515264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868649.258074:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939515264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868649.258582:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868649.258598:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868649.258643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868649.258691:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515520 00000100:00100000:2.0:1787868649.258696:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515520 00000100:00100000:2.0:1787868649.258725:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787868649.258879:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868649.258896:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868649.258942:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868649.258949:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787868649.259024:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9881921c0 x1874715939515520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868649.259044:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868649.260343:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939515392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868649.260422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868649.260543:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515392 00000100:00100000:0.0:1787868649.260552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515392 00000100:00100000:0.0:1787868649.260624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787868649.260634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939515392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868649.260687:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868649.260753:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939515392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868649.260762:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787868649.262913:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939515392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787868649.571721:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868650.026358:0:10932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing yml_node 00010000:00010000:1.0:1787868650.593501:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868651.620848:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868652.259722:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868652.259776:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868652.259815:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868652.260186:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476288 00000100:00100000:3.0:1787868652.260196:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476288 00000100:00100000:3.0:1787868652.260255:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 281 00000100:00100000:3.0:1787868652.260266:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918476288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868652.260350:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918476288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 85us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868652.260370:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 281 00000100:00100000:0.0:1787868652.261152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476416 00000100:00100000:0.0:1787868652.261190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476416 00000100:00100000:0.0:1787868652.261235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476544 00000100:00100000:0.0:1787868652.261238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476544 00000100:00100000:0.0:1787868652.261259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:0.0:1787868652.261269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918476416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868652.261311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918476416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 45us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868652.261318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:0.0:1787868652.261345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:0.0:1787868652.261352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918476544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868652.261378:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918476544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868652.261465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00080000:1.0:1787868652.261754:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868652.261759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787868652.642126:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787868652.839099:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:2.0:1787868652.839109:0:8423:0:(genops.c:885:class_export_put()) final put ffff93dab6f6c000/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:0.0:1787868652.841100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6c000/666039a7-1461-4e99-8c4e-10237114565a for lustre-OST0000 00000020:00000080:0.0:1787868652.841205:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6f6a800 for lustre-OST0000 00000001:00100000:2.0:1787868652.842744:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:2.0:1787868652.842752:0:9508:0:(genops.c:885:class_export_put()) final put ffff93d986312800/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:1.0:1787868652.842873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986312800/666039a7-1461-4e99-8c4e-10237114565a for lustre-OST0001 00000020:00000080:1.0:1787868652.843055:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986310000 for lustre-OST0001 00010000:00010000:1.0:1787868653.665550:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868653.859065:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988804b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868653.859145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859224:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939516160:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859274:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939516672:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859315:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939517184:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859362:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868653.859368:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939516032:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859410:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939516544:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859448:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939517056:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859527:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939515776:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.859558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.859600:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939516288:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860231:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516672 00000100:00100000:2.0:1787868653.860241:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516672 00000100:00100000:2.0:1787868653.860298:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517184 00000100:00100000:2.0:1787868653.860301:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517184 00000100:00100000:2.0:1787868653.860323:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787868653.860333:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939516672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860401:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939516672:12345-0@lo:400:kworker.0 Request processed in 69us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860408:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787868653.860427:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787868653.860434:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939517184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860460:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939517184:12345-0@lo:400:kworker.0 Request processed in 27us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860466:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787868653.860494:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516160 00000100:00100000:2.0:1787868653.860497:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516160 00000100:00100000:2.0:1787868653.860517:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516544 00000100:00100000:2.0:1787868653.860520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516544 00000100:00100000:2.0:1787868653.860533:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517056 00000100:00100000:2.0:1787868653.860535:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517056 00000100:00100000:2.0:1787868653.860549:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787868653.860556:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939516160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939516160:12345-0@lo:400:kworker.0 Request processed in 44us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860606:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787868653.860616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787868653.860758:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939516544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860799:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939516544:12345-0@lo:400:kworker.0 Request processed in 33us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860806:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787868653.860819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787868653.860826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.860852:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939517056:12345-0@lo:400:kworker.0 Request processed in 27us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787868653.860874:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515648 00000100:00100000:2.0:1787868653.860877:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515648 00000100:00100000:2.0:1787868653.860901:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868653.860907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868653.860928:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868653.860956:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939515648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.860962:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868653.860983:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939515904:0@lo:400:kworker.0 00000100:00100000:0.0:1787868653.861223:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515776 00000100:00100000:0.0:1787868653.861228:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515776 00000100:00100000:0.0:1787868653.861258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787868653.861265:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939515776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868653.861304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939515776:12345-0@lo:400:kworker.0 Request processed in 40us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868653.861310:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787868653.861339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516032 00000100:00100000:0.0:1787868653.861343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516032 00000100:00100000:0.0:1787868653.861367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787868653.861374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939516032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868653.861405:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939516032:12345-0@lo:400:kworker.0 Request processed in 32us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868653.861411:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787868653.861485:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939517568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868653.861517:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.861908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868653.863796:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516288 00000100:00100000:0.0:1787868653.863809:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516288 00000100:00100000:0.0:1787868653.863857:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787868653.863875:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939516288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.864434:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939516800:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.864501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868653.864526:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939517312:0@lo:400:kworker.0 00000100:00100000:1.0:1787868653.864551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868653.865577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868653.865615:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939516416:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.865644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868653.865660:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939516928:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.865676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868653.865690:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988804f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939517440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868653.865708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868653.865763:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517568 00000100:00100000:2.0:1787868653.865769:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517568 00000100:00100000:2.0:1787868653.865797:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787868653.865804:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939517568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868653.865824:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868653.865860:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939517568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (4343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.865867:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787868653.865886:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517440 00000100:00100000:2.0:1787868653.865889:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517440 00000100:00100000:2.0:1787868653.865902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787868653.865907:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939517440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868653.865929:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868653.865958:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939517440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.865964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787868653.865978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939515904 00000100:00100000:2.0:1787868653.865981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939515904 00000100:00100000:2.0:1787868653.866211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516416 00000100:00100000:2.0:1787868653.866215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516416 00000100:00100000:2.0:1787868653.866230:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516928 00000100:00100000:2.0:1787868653.866232:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516928 00000100:00100000:2.0:1787868653.866253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787868653.866259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939515904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939515904:12345-0@lo:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.866297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787868653.866308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787868653.866320:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939516416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939516416:12345-0@lo:400:kworker.0 Request processed in 46us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.866371:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787868653.866392:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787868653.866399:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939516928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866427:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939516928:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.866432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787868653.866452:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868653.866456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868653.866459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868653.866461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787868653.866581:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e3c00 x1874715939517568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866602:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939517568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868653.866651:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939516032:0@lo:400:kworker.0 00010000:00080000:2.0:1787868653.866664:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988805680 x1874715939516544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866673:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939516544:0@lo:400:kworker.0 00010000:00080000:2.0:1787868653.866684:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988805a40 x1874715939517056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866692:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939517056:0@lo:400:kworker.0 00010000:00080000:2.0:1787868653.866704:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988804b40 x1874715939515648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866723:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988804b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939515648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868653.866739:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939516160:0@lo:400:kworker.0 00010000:00080000:2.0:1787868653.866748:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888061c0 x1874715939516672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866754:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939516672:0@lo:400:kworker.0 00010000:00080000:2.0:1787868653.866764:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988806d00 x1874715939517184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868653.866771:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939517184:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866815:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939515904:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866826:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939516416:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866834:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939516928:0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.866845:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988804f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939517440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868653.866901:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939516800 00000100:00100000:2.0:1787868653.866906:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939516800 00000100:00100000:2.0:1787868653.866937:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517312 00000100:00100000:2.0:1787868653.866940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517312 00000100:00100000:2.0:1787868653.866969:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868653.866978:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939516800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.867086:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939516800:12345-0@lo:400:kworker.0 Request processed in 111us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.867093:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868653.867115:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787868653.867122:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868653.867191:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939517312:12345-0@lo:400:kworker.0 Request processed in 71us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868653.867198:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787868653.867221:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868653.869609:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939515776:0@lo:400:kworker.0 00010000:00080000:1.0:1787868653.869650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888043c0 x1874715939516800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868653.869662:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939516800:0@lo:400:kworker.0 00010000:00080000:1.0:1787868653.869675:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988807c00 x1874715939517312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868653.869683:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939517312:0@lo:400:kworker.0 00000100:00100000:0.0:1787868653.870307:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939516288:12345-0@lo:400:kworker.0 Request processed in 6430us (10677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868653.870320:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787868653.871714:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939516288:0@lo:400:kworker.0 00000100:00100000:0.0:1787868654.371282:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939517696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868654.371369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868654.371444:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517696 00000100:00100000:0.0:1787868654.371451:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517696 00000100:00100000:0.0:1787868654.371512:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868654.371522:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939517696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868654.371553:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868654.372514:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939517696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 990us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868654.372523:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787868654.372695:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e2d00 x1874715939517696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868654.372716:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939517696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868654.374351:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868654.374372:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939517824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868654.374450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868654.374521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517824 00000100:00100000:0.0:1787868654.374527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517824 00000100:00100000:0.0:1787868654.374704:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787868654.374717:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939517824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868654.374749:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868654.374797:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939517824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868654.374805:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787868654.374857:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939517824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868654.375133:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868654.375143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939517952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868654.375188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868654.375222:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939517952 00000100:00100000:3.0:1787868654.375228:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939517952 00000100:00100000:3.0:1787868654.375275:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787868654.375285:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939517952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868654.375300:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868654.375345:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939517952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868654.375353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787868654.375387:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c0000 x1874715939517952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868654.375403:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939517952:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1787868654.507402:0:11116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.99 00010000:00010000:0.0:1787868654.689260:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868655.714443:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868656.744983:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787868657.274953:0:11213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.99 00000100:00100000:0.0:1787868657.370989:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868657.371036:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868657.371063:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868657.371093:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476928 00000100:00100000:0.0:1787868657.371101:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476928 00000100:00100000:0.0:1787868657.371188:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476800 00000100:00100000:0.0:1787868657.371192:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476800 00000100:00100000:0.0:1787868657.371219:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:0.0:1787868657.371228:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918476928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868657.371530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918476672 00000100:00100000:3.0:1787868657.371534:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918476672 00000100:00100000:3.0:1787868657.371564:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 283 00000100:00100000:3.0:1787868657.371571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2404:x1874715918476672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868657.371634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2404:x1874715918476672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 64us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868657.371641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 283 00000100:00100000:0.0:1787868657.373392:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918476928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2159us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868657.373414:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:0.0:1787868657.373449:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:0.0:1787868657.373461:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918476800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868657.373489:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918476800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868657.374859:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00080000:0.0:1787868657.374897:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868657.374901:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787868657.766919:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868658.785708:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868658.978124:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939518080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868658.978224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868658.978294:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868658.978301:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939518208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868658.978323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868658.978428:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518080 00000100:00100000:2.0:1787868658.978436:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518080 00000100:00100000:2.0:1787868658.978497:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518208 00000100:00100000:2.0:1787868658.978500:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518208 00000100:00100000:2.0:1787868658.978520:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868658.978529:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939518080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868658.978558:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868658.978601:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939518080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.978609:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868658.978625:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787868658.978630:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939518208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868658.978640:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868658.978664:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939518208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.978669:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787868658.978881:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868658.978908:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e12c0 x1874715939518208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868658.978926:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939518208:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787868658.978938:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988807c00 x1874715939518080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868658.978949:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939518080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868658.979822:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868658.979837:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939518336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868658.979885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.980008:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518336 00000100:00100000:1.0:1787868658.980014:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518336 00000100:00100000:1.0:1787868658.980058:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787868658.980077:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939518336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868658.980108:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868658.980179:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939518336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868658.980186:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787868658.980296:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939518336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868658.981788:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939518848:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.981846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868658.981899:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939519360:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.981926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868658.981960:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787868658.981966:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939518464:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.981990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868658.982011:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939518976:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868658.982050:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939519488:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868658.982116:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519360 00000100:00100000:0.0:1787868658.982123:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519360 00000100:00100000:0.0:1787868658.982204:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518976 00000100:00100000:0.0:1787868658.982207:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518976 00000100:00100000:0.0:1787868658.982228:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868658.982236:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939519360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982283:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939519360:12345-0@lo:400:kworker.0 Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868658.982290:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868658.982306:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868658.982312:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939518976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982338:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939518976:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868658.982344:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868658.982361:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518464 00000100:00100000:0.0:1787868658.982364:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518464 00000100:00100000:0.0:1787868658.982716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787868658.982725:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939518464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982778:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939518464:12345-0@lo:400:kworker.0 Request processed in 55us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868658.982784:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787868658.982817:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519488 00000100:00100000:0.0:1787868658.982821:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519488 00000100:00100000:0.0:1787868658.982849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787868658.982856:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982885:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939519488:12345-0@lo:400:kworker.0 Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868658.982891:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787868658.982919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868658.982924:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868658.982926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868658.982951:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939518464:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.982965:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939518976:0@lo:400:kworker.0 00010000:00080000:0.0:1787868658.982978:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008000 x1874715939519488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868658.982990:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939519488:0@lo:400:kworker.0 00010000:00080000:0.0:1787868658.982999:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700a1c0 x1874715939519360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868658.983007:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939519360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.983869:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939518720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.983917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.983950:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939519232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.983972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.984004:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868658.984011:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939518592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.984031:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.984047:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939519104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.984065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.984078:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939519616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.984099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868658.984133:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519616 00000100:00100000:1.0:1787868658.984138:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519616 00000100:00100000:1.0:1787868658.984209:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787868658.984217:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939519616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.984261:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939519616:12345-0@lo:400:kworker.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868658.984279:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787868658.984317:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939519616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868658.984327:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939519616:0@lo:400:kworker.0 00000100:00100000:2.0:1787868658.984444:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518720 00000100:00100000:2.0:1787868658.984457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518720 00000100:00100000:2.0:1787868658.984479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519232 00000100:00100000:2.0:1787868658.984482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519232 00000100:00100000:2.0:1787868658.984507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518592 00000100:00100000:2.0:1787868658.984509:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518592 00000100:00100000:2.0:1787868658.984518:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519104 00000100:00100000:2.0:1787868658.984521:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519104 00000100:00100000:2.0:1787868658.984535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787868658.984541:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939518720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868658.984590:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939518720:12345-0@lo:400:kworker.0 Request processed in 49us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.984596:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787868658.984610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787868658.984616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939519232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868658.984642:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939519232:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.984647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787868658.984657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787868658.984662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939518592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868658.984685:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939518592:12345-0@lo:400:kworker.0 Request processed in 23us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.984691:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787868658.984701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787868658.984707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939519104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868658.984732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939519104:12345-0@lo:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868658.984737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787868658.984997:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939518848 00000100:00100000:3.0:1787868658.985002:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939518848 00000100:00100000:3.0:1787868658.985045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868658.985053:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939518848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868658.985100:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939518848:12345-0@lo:400:kworker.0 Request processed in 49us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868658.985106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787868658.985336:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868658.985342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868658.985345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868658.985580:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939518592:0@lo:400:kworker.0 00010000:00080000:1.0:1787868658.985594:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b0c0 x1874715939519104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868658.985604:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939519104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.985616:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939518720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868658.985625:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939519232:0@lo:400:kworker.0 00000100:00100000:0.0:1787868658.985691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939518848:0@lo:400:kworker.0 00000100:00100000:2.0:1787868659.489383:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939519744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868659.489545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868659.489621:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519744 00000100:00100000:3.0:1787868659.489645:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519744 00000100:00100000:0.0:1787868659.490227:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939519872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868659.490268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868659.490347:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939519872 00000100:00100000:3.0:1787868659.490352:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939519872 00000100:00100000:3.0:1787868659.490416:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868659.490427:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939519872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868659.490461:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868659.490521:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939519872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868659.490529:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787868659.490618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939519872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868659.493383:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868659.493398:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939519744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868659.493432:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868659.493510:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939519744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868659.493517:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787868659.493610:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700a940 x1874715939519744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868659.493632:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939519744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868659.496585:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868659.496608:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939520000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868659.496680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868659.496746:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520000 00000100:00100000:0.0:1787868659.496754:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520000 00000100:00100000:0.0:1787868659.496812:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787868659.496822:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939520000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868659.496846:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868659.496892:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939520000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (212us total) trans 0 rc 0/0 00010000:00080000:2.0:1787868659.496923:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b480 x1874715939520000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868659.496940:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939520000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868659.497072:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1787868659.811546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787868659.932272:0:11311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.99 00010000:00010000:2.0:1787868660.834586:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868661.630706:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 18:10:59 EDT 2026 00010000:00010000:2.0:1787868661.864777:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868662.498315:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868662.498364:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868662.498487:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868662.498525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477184 00000100:00100000:1.0:1787868662.498538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477184 00000100:00100000:1.0:1787868662.498628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477312 00000100:00100000:1.0:1787868662.498632:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477312 00000100:00100000:1.0:1787868662.498662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1787868662.498675:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918477184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868662.498780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918477184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 108us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868662.498789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1787868662.498825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1787868662.498831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918477312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868662.498859:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918477312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868662.498866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00080000:1.0:1787868662.498893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868662.498898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868662.500238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477056 00000100:00100000:2.0:1787868662.500253:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477056 00000100:00100000:2.0:1787868662.500335:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 285 00000100:00100000:2.0:1787868662.500348:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918477056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868662.500449:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918477056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 105us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868662.500457:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 285 00010000:00010000:1.0:1787868662.881813:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868663.912925:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868664.100902:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939520512:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.100988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101054:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939521024:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101106:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939521536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101180:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787868664.101186:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939520384:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101231:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939520896:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101268:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939521408:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.101335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520512 00000100:00100000:3.0:1787868664.101342:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520512 00000100:00100000:3.0:1787868664.101394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520896 00000100:00100000:3.0:1787868664.101398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520896 00000100:00100000:3.0:1787868664.101420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521408 00000100:00100000:3.0:1787868664.101423:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521408 00000100:00100000:3.0:1787868664.101441:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787868664.101450:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939520512:12345-0@lo:400:kworker.0 Request processed in 364us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.101824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787868664.101842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868664.101849:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939520896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939520896:12345-0@lo:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.101883:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868664.101893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787868664.101899:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.101925:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939521408:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.101931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787868664.101948:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521024 00000100:00100000:3.0:1787868664.101951:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521024 00000100:00100000:3.0:1787868664.101976:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521536 00000100:00100000:3.0:1787868664.101979:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521536 00000100:00100000:3.0:1787868664.101997:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868664.102003:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102031:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939521024:12345-0@lo:400:kworker.0 Request processed in 29us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.102047:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868664.102059:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787868664.102065:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102095:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939521536:12345-0@lo:400:kworker.0 Request processed in 31us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.102101:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787868664.102116:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939520128:0@lo:400:kworker.0 00000100:00080000:3.0:1787868664.102128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868664.102132:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868664.102135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868664.102180:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700a1c0 x1874715939520896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868664.102180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.102195:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939520896:0@lo:400:kworker.0 00010000:00080000:3.0:1787868664.102207:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbf480 x1874715939521408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868664.102208:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939520640:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102215:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939521408:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102224:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939520512:0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787868664.102233:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008000 x1874715939521024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868664.102241:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939521024:0@lo:400:kworker.0 00010000:00080000:3.0:1787868664.102250:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd680 x1874715939521536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868664.102253:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939521152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102259:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939521536:0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868664.102300:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939521664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102307:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521152 00000100:00100000:3.0:1787868664.102316:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521152 00000100:00100000:1.0:1787868664.102320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868664.102336:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868664.102337:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521664 00000100:00100000:3.0:1787868664.102340:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521664 00000100:00100000:1.0:1787868664.102343:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939520256:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102352:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868664.102357:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939521152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102362:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868664.102393:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939520768:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102394:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939521152:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.102399:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868664.102410:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787868664.102412:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.102416:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939521664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102426:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939521280:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.102439:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939521664:12345-0@lo:400:kworker.0 Request processed in 24us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868664.102443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868664.102445:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787868664.102462:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbe940 x1874715939521152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868664.102464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520384 00000100:00100000:3.0:1787868664.102466:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520384 00000100:00100000:1.0:1787868664.102485:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939521152:0@lo:400:kworker.0 00010000:00080000:1.0:1787868664.102498:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbe1c0 x1874715939521664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868664.102506:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939521664:0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520128 00000100:00100000:1.0:1787868664.102539:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520128 00000100:00100000:1.0:1787868664.102567:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787868664.102573:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939520128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939520128:12345-0@lo:400:kworker.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868664.102614:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787868664.102647:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939520128:0@lo:400:kworker.0 00000100:00100000:1.0:1787868664.102874:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868664.102883:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939521792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868664.102909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868664.103669:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868664.103704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868664.103746:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520640 00000100:00100000:2.0:1787868664.103750:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520640 00000100:00100000:2.0:1787868664.103781:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787868664.103788:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939520640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868664.103833:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939520640:12345-0@lo:400:kworker.0 Request processed in 46us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868664.103849:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787868664.103882:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521792 00000100:00100000:2.0:1787868664.103886:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521792 00000100:00100000:2.0:1787868664.103901:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521920 00000100:00100000:2.0:1787868664.103904:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521920 00000100:00100000:2.0:1787868664.103914:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787868664.103919:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939521792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868664.103939:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868664.103968:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939521792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868664.103973:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787868664.103982:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787868664.103987:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939521920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868664.103994:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868664.104015:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939521920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868664.104021:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787868664.104045:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988807480 x1874715939521920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868664.104060:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939521920:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787868664.104083:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733a1c0 x1874715939521792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868664.104093:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939521792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868664.104103:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939520640:0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.105377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868664.105396:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939520384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.105464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939520384:12345-0@lo:400:kworker.0 Request processed in 74us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.105552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787868664.107902:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868664.107973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868664.108034:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939520384:0@lo:400:kworker.0 00000100:00080000:2.0:1787868664.108241:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868664.108246:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868664.108354:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522048 00000100:00100000:3.0:1787868664.108369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522048 00000100:00100000:3.0:1787868664.108423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787868664.108432:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868664.108465:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868664.108715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 283us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.108738:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787868664.108761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520256 00000100:00100000:3.0:1787868664.108764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520256 00000100:00100000:3.0:1787868664.108790:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939520768 00000100:00100000:3.0:1787868664.108793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939520768 00000100:00100000:3.0:1787868664.108813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939521280 00000100:00100000:3.0:1787868664.108816:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939521280 00000100:00100000:3.0:1787868664.108828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787868664.108834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939520256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.108868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939520256:12345-0@lo:400:kworker.0 Request processed in 34us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.108874:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787868664.108882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787868664.108888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.108910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939520768:12345-0@lo:400:kworker.0 Request processed in 23us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.108916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787868664.108923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787868664.108928:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868664.108948:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939521280:12345-0@lo:400:kworker.0 Request processed in 20us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868664.108953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787868664.108970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868664.109072:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868664.109102:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939520256:0@lo:400:kworker.0 00000100:00100000:2.0:1787868664.109111:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939520768:0@lo:400:kworker.0 00000100:00100000:2.0:1787868664.109122:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939521280:0@lo:400:kworker.0 00000100:00100000:2.0:1787868664.611288:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939522176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868664.611361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868664.611381:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868664.611404:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868664.611430:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868664.611433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868664.611435:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868664.611457:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868664.611471:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522432 00000100:00100000:1.0:1787868664.611479:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522432 00000100:00100000:2.0:1787868664.611484:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522304 00000100:00100000:2.0:1787868664.611486:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522304 00000100:00100000:2.0:1787868664.611521:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787868664.611530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939522304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868664.611538:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522176 00000100:00100000:0.0:1787868664.611541:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522176 00002000:00000024:2.0:1787868664.611559:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868664.611568:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787868664.611574:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939522176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868664.611596:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868664.611601:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939522304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868664.611608:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787868664.611623:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939522176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868664.611634:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787868664.612150:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868664.612198:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868664.612212:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868664.612250:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868664.612277:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787868664.612367:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700da40 x1874715939522432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868664.612388:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522432:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787868664.612602:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888070c0 x1874715939522304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868664.612615:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868664.612634:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939522176:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787868664.929547:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868665.959983:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868666.977587:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868667.609863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868667.609923:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868667.609949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477568 00000100:00100000:3.0:1787868667.609964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477568 00000100:00100000:1.0:1787868667.609966:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868667.610064:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477440 00000100:00100000:0.0:1787868667.610069:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477440 00000100:00100000:0.0:1787868667.610115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:0.0:1787868667.610127:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918477440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868667.610276:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918477440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 151us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868667.610285:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:2.0:1787868667.612255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477696 00000100:00100000:2.0:1787868667.612304:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477696 00000100:00100000:2.0:1787868667.612394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1787868667.612406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918477568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868667.612512:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918477568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 109us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868667.612520:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1787868667.612539:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:2.0:1787868667.612545:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918477696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868667.612572:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918477696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868667.612579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00080000:2.0:1787868667.613350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868667.613360:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787868668.001481:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868669.025708:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868669.218383:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868669.218462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218535:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939523072:0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.218570:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939522688:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218591:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939523584:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218642:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939524096:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218680:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787868669.218686:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522944:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868669.218736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218745:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939523456:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218788:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939523968:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.218807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.218839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522560 00000100:00100000:2.0:1787868669.218846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522560 00000100:00100000:2.0:1787868669.218888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522944 00000100:00100000:2.0:1787868669.218891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522944 00000100:00100000:2.0:1787868669.218908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787868669.218917:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939522560:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868669.218949:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939523200:0@lo:400:kworker.0 00000004:00000024:2.0:1787868669.218953:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868669.218980:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868669.218998:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939523712:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939522560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787868669.219027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.219038:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523200 00000100:00100000:2.0:1787868669.219042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523200 00000100:00100000:3.0:1787868669.219058:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524224:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787868669.219071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.219088:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.219114:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939522944:12345-0@lo:400:kworker.0 Request processed in 43us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868669.219117:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787868669.219123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787868669.219127:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939522816:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868669.219146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219218:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939523200:12345-0@lo:400:kworker.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219224:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868669.219243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523072 00000100:00100000:2.0:1787868669.219252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523072 00000100:00100000:2.0:1787868669.219279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523456 00000100:00100000:2.0:1787868669.219283:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523456 00000100:00100000:2.0:1787868669.219305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523968 00000100:00100000:2.0:1787868669.219308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523968 00000100:00100000:2.0:1787868669.219322:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787868669.219328:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939523072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219362:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939523072:12345-0@lo:400:kworker.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787868669.219380:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787868669.219389:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.219392:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868669.219414:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939523328:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219425:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939523456:12345-0@lo:400:kworker.0 Request processed in 39us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787868669.219443:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522816 00000100:00100000:2.0:1787868669.219447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522816 00000100:00100000:3.0:1787868669.219448:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.219463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523328 00000100:00100000:3.0:1787868669.219467:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939523840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219468:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523328 00000100:00100000:2.0:1787868669.219489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787868669.219497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868669.219499:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988805e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939523968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.219532:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939523200:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219538:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988805e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939523968:12345-0@lo:400:kworker.0 Request processed in 40us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787868669.219558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523840 00000100:00100000:2.0:1787868669.219561:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523840 00000100:00100000:3.0:1787868669.219573:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523584 00000100:00100000:2.0:1787868669.219582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787868669.219588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939522816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939522816:12345-0@lo:400:kworker.0 Request processed in 56us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787868669.219663:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787868669.219668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939523328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939523328:12345-0@lo:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219696:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787868669.219705:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787868669.219711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939523840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.219718:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523584 00000100:00100000:2.0:1787868669.219738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939523840:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868669.219744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787868669.219782:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522944:0@lo:400:kworker.0 00010000:00080000:2.0:1787868669.219795:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd680 x1874715939523456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.219806:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939523456:0@lo:400:kworker.0 00010000:00080000:2.0:1787868669.219816:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbe940 x1874715939523968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.219824:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939523968:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219834:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939523072:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.219848:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939522560:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787868669.219881:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868669.219885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868669.219887:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868669.220281:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939522688 00000100:00100000:1.0:1787868669.220287:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939522688 00000100:00100000:1.0:1787868669.220330:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787868669.220339:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939522688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868669.220380:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939522688:12345-0@lo:400:kworker.0 Request processed in 44us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868669.220387:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787868669.220420:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524096 00000100:00100000:1.0:1787868669.220424:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524096 00000100:00100000:2.0:1787868669.222931:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939522816:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.222951:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939523328:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.222963:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939523840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.222972:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939522688:0@lo:400:kworker.0 00000100:00100000:2.0:1787868669.222993:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868669.223010:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868669.223072:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868669.223293:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868669.223357:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868669.224090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868669.224128:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939523712 00000100:00100000:3.0:1787868669.224137:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939523712 00000100:00100000:1.0:1787868669.226901:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524224 00000100:00100000:1.0:1787868669.226914:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524224 00000100:00100000:1.0:1787868669.227082:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787868669.227092:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939523584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868669.227760:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939523584:12345-0@lo:400:kworker.0 Request processed in 667us (9142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868669.227770:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787868669.227791:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787868669.227800:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939524096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868669.227831:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939524096:12345-0@lo:400:kworker.0 Request processed in 34us (9168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868669.227853:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787868669.227866:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787868669.227871:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868669.227916:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524224:12345-0@lo:400:kworker.0 Request processed in 44us (8828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868669.227922:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868669.228300:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868669.228311:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939523712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868669.228356:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939523712:12345-0@lo:400:kworker.0 Request processed in 48us (9329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868669.228363:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787868669.228408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868669.228412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787868669.228588:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939524096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.228603:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939524096:0@lo:400:kworker.0 00010000:00080000:2.0:1787868669.228615:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbf480 x1874715939523584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.228624:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939523584:0@lo:400:kworker.0 00010000:00080000:2.0:1787868669.228654:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbf840 x1874715939523712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.228662:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939523712:0@lo:400:kworker.0 00010000:00080000:2.0:1787868669.228672:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700bc00 x1874715939524224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868669.228688:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524224:0@lo:400:kworker.0 00000100:00100000:0.0:1787868669.230404:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524352 00000100:00100000:0.0:1787868669.230417:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524352 00000100:00100000:0.0:1787868669.230460:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524480 00000100:00100000:0.0:1787868669.230463:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524480 00000100:00100000:0.0:1787868669.230479:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868669.230488:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868669.230517:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868669.230588:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (7515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868669.230595:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787868669.230611:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868669.230618:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939524480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868669.230629:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868669.230658:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939524480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (6570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868669.230664:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787868669.230719:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd851a40 x1874715939524352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868669.230755:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524352:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787868669.230809:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988807c00 x1874715939524480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868669.230823:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868669.731954:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868669.731980:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868669.732045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868669.732112:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524736 00000100:00100000:3.0:1787868669.732120:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524736 00000100:00100000:3.0:1787868669.732195:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787868669.732206:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939524736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868669.732234:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868669.732288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939524736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868669.732294:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787868669.732336:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939524736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868669.732353:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868669.733527:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868669.733545:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868669.733593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868669.733645:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868669.733652:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868669.733677:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868669.733709:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524608 00000100:00100000:0.0:1787868669.733715:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524608 00000100:00100000:0.0:1787868669.733761:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787868669.733769:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939524608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868669.733785:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868669.733820:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939524608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868669.733827:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787868669.733848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524864 00000100:00100000:0.0:1787868669.733852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524864 00000100:00100000:0.0:1787868669.733878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787868669.733885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868669.733911:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868669.733944:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939524864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868669.733950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787868669.733990:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939524864:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787868669.734029:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700bc00 x1874715939524608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868669.734043:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524608:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787868670.049404:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868671.074814:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868672.109339:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868672.728825:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868672.728872:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868672.728902:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868672.728938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477824 00000100:00100000:1.0:1787868672.728948:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477824 00000100:00100000:2.0:1787868672.728987:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918477952 00000100:00100000:2.0:1787868672.728991:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918477952 00000100:00100000:1.0:1787868672.729002:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:1.0:1787868672.729012:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918477824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868672.729030:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478080 00000100:00100000:2.0:1787868672.729032:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478080 00000100:00100000:2.0:1787868672.729052:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:1.0:1787868672.729088:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2406:x1874715918477824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868672.729095:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:2.0:1787868672.729142:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918477952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868672.729146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:1.0:1787868672.729152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918478080:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868672.729195:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918477952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 56us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868672.729202:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00080000:2.0:1787868672.729220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868672.729224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868672.734123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918478080:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 4947us (5197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868672.734139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00010000:00010000:3.0:1787868673.130094:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868674.146765:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868674.337427:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.337463:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939525120:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.337581:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868674.342638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.342717:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939525760:0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.342773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.342797:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939526272:0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.342818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868674.342894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.342902:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787868674.342913:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939525376:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.342930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525248 00000100:00100000:3.0:1787868674.342939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525248 00000100:00100000:2.0:1787868674.342958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.342982:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939525888:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.342987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525760 00000100:00100000:3.0:1787868674.342992:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525760 00000100:00100000:2.0:1787868674.343020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.343041:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939526400:0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.343064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.343111:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526272 00000100:00100000:2.0:1787868674.343115:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526272 00000100:00100000:0.0:1787868674.343484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.343501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939525504:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.343607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.343619:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939526016:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.343649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.343668:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939526528:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.343685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.343776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525376 00000100:00100000:0.0:1787868674.343780:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525376 00000100:00100000:0.0:1787868674.343807:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939524992 00000100:00100000:0.0:1787868674.343811:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939524992 00000100:00100000:0.0:1787868674.343828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787868674.343836:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525888 00000100:00100000:0.0:1787868674.343838:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939525376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.343843:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525888 00000100:00100000:2.0:1787868674.343971:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526400 00000100:00100000:2.0:1787868674.343975:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526400 00000100:00100000:2.0:1787868674.343986:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525504 00000100:00100000:2.0:1787868674.343988:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525504 00000100:00100000:2.0:1787868674.343998:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787868674.344004:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939525248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.344039:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939525248:12345-0@lo:400:kworker.0 Request processed in 35us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.344046:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787868674.344059:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787868674.344064:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.344099:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939525760:12345-0@lo:400:kworker.0 Request processed in 35us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.344105:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787868674.344114:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787868674.344119:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939526272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.344138:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939526272:12345-0@lo:400:kworker.0 Request processed in 20us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.344143:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787868674.344152:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868674.344171:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939526400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.345708:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939526400:12345-0@lo:400:kworker.0 Request processed in 1542us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.345729:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868674.345757:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868674.345767:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939525504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868674.345815:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939525504:12345-0@lo:400:kworker.0 Request processed in 51us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.345821:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868674.345850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787868674.345858:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939524992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868674.345885:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868674.345960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939524992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.345966:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787868674.346439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939525376:12345-0@lo:400:kworker.0 Request processed in 2602us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.346445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787868674.346471:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526016 00000100:00100000:0.0:1787868674.346478:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526016 00000100:00100000:0.0:1787868674.346519:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526528 00000100:00100000:0.0:1787868674.346523:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526528 00000100:00100000:0.0:1787868674.346558:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787868674.346566:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939526016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.346606:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939526016:12345-0@lo:400:kworker.0 Request processed in 42us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.346611:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787868674.346620:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787868674.346625:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939526528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.346648:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939526528:12345-0@lo:400:kworker.0 Request processed in 22us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.346652:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787868674.346680:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988300780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868674.346713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.346752:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868674.346759:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939526784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868674.346780:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868674.346804:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526912 00000100:00100000:0.0:1787868674.346808:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526912 00000100:00100000:0.0:1787868674.346827:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526784 00000100:00100000:0.0:1787868674.346830:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526784 00000100:00100000:0.0:1787868674.346841:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787868674.346847:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939526912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868674.346865:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868674.346896:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939526912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.346902:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787868674.346912:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787868674.346918:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939526784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868674.346927:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868674.346958:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939526784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.346964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787868674.347003:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988300f00 x1874715939526784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.347021:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939526784:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787868674.347030:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988300780 x1874715939526912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.347040:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988300780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868674.347108:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939525376:0@lo:400:kworker.0 00010000:00080000:0.0:1787868674.347124:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700bc00 x1874715939526400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.347132:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939526400:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.347145:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939525248:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.347177:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939525760:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.347190:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939526272:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.347235:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939524992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868674.347247:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939525504:0@lo:400:kworker.0 00010000:00080000:0.0:1787868674.347257:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbc000 x1874715939526016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.347265:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939526016:0@lo:400:kworker.0 00010000:00080000:0.0:1787868674.347286:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939526528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.347294:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939526528:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.349559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787868674.349576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939525888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.349664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939525888:12345-0@lo:400:kworker.0 Request processed in 93us (6643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868674.349671:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787868674.349693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868674.349929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525120 00000100:00100000:0.0:1787868674.349938:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525120 00000100:00100000:0.0:1787868674.349978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787868674.349985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.350024:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939525120:12345-0@lo:400:kworker.0 Request processed in 40us (7131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.350030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00080000:0.0:1787868674.350113:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd680 x1874715939525888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868674.350128:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939525888:0@lo:400:kworker.0 00000100:00080000:3.0:1787868674.350913:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868674.350916:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868674.350919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868674.350968:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939525120:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.350980:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939525632:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.351294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868674.351331:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939526144:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.351357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868674.351374:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939526656:0@lo:400:kworker.0 00000100:00100000:3.0:1787868674.351394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868674.351920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939525632 00000100:00100000:1.0:1787868674.351926:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939525632 00000100:00100000:1.0:1787868674.351975:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787868674.351996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939525632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868674.352051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939525632:12345-0@lo:400:kworker.0 Request processed in 58us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868674.352058:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787868674.352136:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526144 00000100:00100000:0.0:1787868674.352140:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526144 00000100:00100000:0.0:1787868674.352195:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939526656 00000100:00100000:0.0:1787868674.352198:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939526656 00000100:00100000:0.0:1787868674.352223:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787868674.352229:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939526144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.352259:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939526144:12345-0@lo:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.352265:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787868674.352275:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787868674.352279:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939526656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.352299:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939526656:12345-0@lo:400:kworker.0 Request processed in 20us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868674.352322:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787868674.352340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868674.352541:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939525632:0@lo:400:kworker.0 00010000:00080000:3.0:1787868674.352555:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbe580 x1874715939526144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868674.352566:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939526144:0@lo:400:kworker.0 00010000:00080000:3.0:1787868674.352575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830d680 x1874715939526656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868674.352583:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939526656:0@lo:400:kworker.0 00000100:00100000:0.0:1787868674.850324:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868674.850358:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988300780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939527040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868674.850454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.850627:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527040 00000100:00100000:2.0:1787868674.850635:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527040 00000100:00100000:2.0:1787868674.850683:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787868674.850692:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939527040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868674.850721:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868674.850759:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868674.850770:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939527168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868674.850785:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939527040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.850793:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787868674.850807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868674.850843:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527168 00000100:00100000:1.0:1787868674.850847:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527168 00000100:00100000:1.0:1787868674.850886:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787868674.850896:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939527168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868674.850921:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868674.851019:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939527168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868674.851026:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1787868674.851109:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988300780 x1874715939527040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868674.851119:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939527168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868674.851129:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988300780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939527040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868674.851353:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868674.851366:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939527296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868674.851399:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868674.851423:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527296 00000100:00100000:2.0:1787868674.851436:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527296 00000100:00100000:2.0:1787868674.851461:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868674.851467:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939527296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868674.851478:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868674.852888:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939527296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1412us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868674.852900:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787868674.853334:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813f840 x1874715939527296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868674.853355:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939527296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787868675.169596:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868676.194134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868677.217402:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868677.853551:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868677.853599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868677.853657:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868677.853692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478464 00000100:00100000:3.0:1787868677.853702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478464 00000100:00100000:0.0:1787868677.853754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478336 00000100:00100000:0.0:1787868677.853761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478336 00000100:00100000:3.0:1787868677.853768:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1787868677.853781:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918478464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868677.853821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:0.0:1787868677.853832:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918478336:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868677.853855:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918478464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868677.853863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:0.0:1787868677.853870:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918478336:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868677.853879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:1.0:1787868677.853959:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478208 00000100:00100000:1.0:1787868677.853964:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478208 00000100:00100000:1.0:1787868677.853998:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00100000:1.0:1787868677.854018:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918478208:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868677.854055:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918478208:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868677.854062:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00080000:3.0:1787868677.854470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868677.854475:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787868678.243395:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868679.266395:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868679.457651:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939527552:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.457768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.457838:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939528064:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.457864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.457886:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939528576:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.457929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.457962:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868679.457968:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939527680:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.458028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.458046:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939528192:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.458068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.458085:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939528704:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.458105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.458131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527552 00000100:00100000:2.0:1787868679.458138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527552 00000100:00100000:2.0:1787868679.458197:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528064 00000100:00100000:2.0:1787868679.458200:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528064 00000100:00100000:2.0:1787868679.458220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528576 00000100:00100000:2.0:1787868679.458228:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528576 00000100:00100000:2.0:1787868679.458244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528192 00000100:00100000:2.0:1787868679.458247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528192 00000100:00100000:2.0:1787868679.458258:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528704 00000100:00100000:2.0:1787868679.458260:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528704 00000100:00100000:1.0:1787868679.458379:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939527808:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458429:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458453:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939528320:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458498:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939528832:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458552:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787868679.458558:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939527424:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458584:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458606:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939527936:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458658:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939528448:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458694:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939528960:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458713:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.458739:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528320 00000100:00100000:1.0:1787868679.458743:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528320 00000100:00100000:1.0:1787868679.458766:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528832 00000100:00100000:1.0:1787868679.458769:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528832 00000100:00100000:1.0:1787868679.458781:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528448 00000100:00100000:1.0:1787868679.458783:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528448 00000100:00100000:1.0:1787868679.458794:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939528960 00000100:00100000:1.0:1787868679.458796:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939528960 00000100:00100000:1.0:1787868679.458810:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868679.458819:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939528320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458872:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939528320:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.458879:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868679.458896:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868679.458909:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.458939:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939528832:12345-0@lo:400:kworker.0 Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.458945:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868679.458958:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868679.458964:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.459004:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939528448:12345-0@lo:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.459010:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868679.459018:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787868679.459024:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.459044:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939528960:12345-0@lo:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.459050:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787868679.459068:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527424 00000100:00100000:1.0:1787868679.459071:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527424 00000100:00100000:1.0:1787868679.459093:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787868679.459099:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939527424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.459127:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939527424:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.459133:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787868679.459210:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939527424:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.459224:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e580 x1874715939528448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.459235:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939528448:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.459253:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813d680 x1874715939528960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.459261:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939528960:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.459283:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813c780 x1874715939528320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.459290:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939528320:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.459299:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813c000 x1874715939528832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.459306:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939528832:0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459570:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527808 00000100:00100000:3.0:1787868679.459575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527808 00000100:00100000:3.0:1787868679.459598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787868679.459605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939527552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459662:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939527552:12345-0@lo:400:kworker.0 Request processed in 57us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.459668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787868679.459681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787868679.459688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939528064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459725:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939528064:12345-0@lo:400:kworker.0 Request processed in 38us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.459731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787868679.459742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787868679.459748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939528576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459775:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939528576:12345-0@lo:400:kworker.0 Request processed in 28us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.459780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787868679.459790:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787868679.459796:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939528192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939528192:12345-0@lo:400:kworker.0 Request processed in 27us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.459828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787868679.459840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787868679.459845:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939527808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.459890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939527808:12345-0@lo:400:kworker.0 Request processed in 45us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.459896:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787868679.459918:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527680 00000100:00100000:3.0:1787868679.459922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527680 00000100:00100000:3.0:1787868679.459945:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939527936 00000100:00100000:3.0:1787868679.459948:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939527936 00000100:00100000:3.0:1787868679.459961:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787868679.459967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daadc60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939527680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.460358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daadc60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939527680:12345-0@lo:400:kworker.0 Request processed in 391us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.460385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787868679.460677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787868679.460685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939527936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.460715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939527936:12345-0@lo:400:kworker.0 Request processed in 32us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.460721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787868679.460738:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868679.460744:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868679.460746:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868679.460749:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868679.460779:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939527936:0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.460791:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939527808:0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.461134:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787868679.461145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868679.461199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939528704:12345-0@lo:400:kworker.0 Request processed in 57us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868679.461206:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868679.466145:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939527680:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.466185:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813cf00 x1874715939528192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.466197:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939528192:0@lo:400:kworker.0 00010000:00080000:1.0:1787868679.466209:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813de00 x1874715939528704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.466218:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939528704:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.466231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939527552:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.466242:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939528064:0@lo:400:kworker.0 00000100:00100000:1.0:1787868679.466254:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939528576:0@lo:400:kworker.0 00000100:00100000:3.0:1787868679.466961:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868679.466988:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939529088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868679.467052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868679.467097:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529088 00000100:00100000:3.0:1787868679.467104:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529088 00000100:00100000:3.0:1787868679.467150:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787868679.467184:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939529088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868679.467213:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868679.467259:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939529088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.467265:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787868679.467315:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830e1c0 x1874715939529088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868679.467350:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939529088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868679.468379:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939529344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868679.468439:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868679.469768:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868679.469789:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868679.469858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868679.469949:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529216 00000100:00100000:1.0:1787868679.469957:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529216 00000100:00100000:1.0:1787868679.470020:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787868679.470030:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939529216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868679.470052:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868679.470101:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939529216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868679.470107:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787868679.470145:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8f0c0 x1874715939529216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868679.470184:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868679.470379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529344 00000100:00100000:3.0:1787868679.470384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529344 00000100:00100000:3.0:1787868679.470423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787868679.470430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939529344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868679.470457:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868679.470547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939529344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.470553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787868679.470593:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939529344:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787868679.733511:0:11988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:11:17 (1787868677) === 00000100:00100000:1.0:1787868679.969375:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868679.969403:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939529472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868679.969474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.969574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529472 00000100:00100000:2.0:1787868679.969582:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529472 00000100:00100000:2.0:1787868679.969640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787868679.969650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939529472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868679.969683:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868679.969733:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939529472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868679.969739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787868679.969783:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939529472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868679.969958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868679.969977:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939529600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868679.970012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868679.970045:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529600 00000100:00100000:2.0:1787868679.970050:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529600 00000100:00100000:2.0:1787868679.970150:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787868679.970182:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939529600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868679.970200:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868679.970251:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939529600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868679.970257:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787868679.970301:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939529728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868679.970325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787868679.970362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988240780 x1874715939529600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868679.970376:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939529600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868679.971533:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529728 00000100:00100000:3.0:1787868679.971542:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529728 00000100:00100000:3.0:1787868679.971583:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787868679.971592:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939529728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868679.971610:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868679.971675:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939529728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868679.971682:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787868679.971954:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988240b40 x1874715939529728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868679.971984:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939529728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868680.223509:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.223631:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478592 00000100:00100000:0.0:1787868680.223642:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478592 00000100:00100000:0.0:1787868680.223699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:0.0:1787868680.223710:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:8742:x1874715918478592:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787868680.223729:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868680.223746:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2d118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fee8e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868680.223794:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2d118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee8e expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868680.223806:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2d118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee8e expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868680.223817:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287a00, rc 0) 00000100:00100000:0.0:1787868680.223888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918478592:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 180us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.223895:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:1.0:1787868680.234797:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868680.234987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478720 00000100:00100000:2.0:1787868680.235001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478720 00000100:00100000:0.0:1787868680.235322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:0.0:1787868680.235359:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918478720:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787868680.235611:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918478720:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 274us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.235620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:3.0:1787868680.238770:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.238870:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478848 00000100:00100000:1.0:1787868680.238884:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478848 00000100:00100000:1.0:1787868680.238989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1787868680.239003:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918478848:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787868680.239284:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918478848:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 282us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868680.239294:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1787868680.248684:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.248807:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918478976 00000100:00100000:0.0:1787868680.248825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918478976 00000100:00100000:0.0:1787868680.249200:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:0.0:1787868680.249214:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918478976:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868680.249403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918478976:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 192us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.249411:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 296 00010000:00010000:2.0:1787868680.289573:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868680.304993:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868680.312669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479104 00000100:00100000:2.0:1787868680.312690:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479104 00000100:00100000:2.0:1787868680.312772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:2.0:1787868680.312783:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918479104:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787868680.312973:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918479104:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 191us (8032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868680.312980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:3.0:1787868680.321307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.322493:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479232 00000100:00100000:0.0:1787868680.322513:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479232 00000100:00100000:0.0:1787868680.322672:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:0.0:1787868680.322698:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918479232:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868680.322948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8745:x1874715918479232:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 252us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.322966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:3.0:1787868680.326742:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.327454:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479360 00000100:00100000:1.0:1787868680.327491:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479360 00000100:00100000:1.0:1787868680.327570:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:1.0:1787868680.327584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:8742:x1874715918479360:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787868680.327609:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868680.327638:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2d11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963feebf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868680.327681:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2d11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feebf expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868680.327695:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2d11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feebf expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868680.327707:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a200, rc 0) 00000100:00100000:1.0:1787868680.327844:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:8742:x1874715918479360:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 262us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868680.327853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:3.0:1787868680.331600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.331698:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479488 00000100:00100000:0.0:1787868680.331713:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479488 00000100:00100000:0.0:1787868680.331798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:0.0:1787868680.331811:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:8742:x1874715918479488:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787868680.331847:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787868680.331883:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787868680.331887:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787868680.331891:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787868680.331895:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787868680.331910:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787868680.334818:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:8742:x1874715918479488:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 2992us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.334838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:1.0:1787868680.341991:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868680.342222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479616 00000100:00100000:2.0:1787868680.342236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479616 00000100:00100000:2.0:1787868680.342316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 301 00000100:00100000:2.0:1787868680.342330:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:8742:x1874715918479616:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787868680.342353:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868680.342380:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963feec6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868680.342447:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868680.342461:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868680.342473:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868680.342559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8742:x1874715918479616:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 233us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868680.342568:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 301 00000100:00100000:2.0:1787868680.345366:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.345545:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479744 00000100:00100000:0.0:1787868680.345559:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479744 00000100:00100000:0.0:1787868680.345635:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:0.0:1787868680.345648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8742:x1874715918479744:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787868680.345939:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8742:x1874715918479744:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 285us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.345948:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:3.0:1787868680.348674:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.348763:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918479872 00000100:00100000:1.0:1787868680.348774:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918479872 00000100:00100000:1.0:1787868680.348907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 303 00000100:00100000:1.0:1787868680.348920:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8742:x1874715918479872:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787868680.349148:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8742:x1874715918479872:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 229us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868680.349184:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 303 00000100:00100000:3.0:1787868680.352464:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.353524:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480000 00000100:00100000:0.0:1787868680.353541:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480000 00000100:00100000:0.0:1787868680.353634:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:0.0:1787868680.353650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8751:x1874715918480000:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868680.353916:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8751:x1874715918480000:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 270us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.353925:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:3.0:1787868680.360725:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.360811:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480128 00000100:00100000:0.0:1787868680.360825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480128 00000100:00100000:0.0:1787868680.360911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:0.0:1787868680.360925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8751:x1874715918480128:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868680.370706:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:8751:x1874715918480128:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 9763us (9977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.370730:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:1.0:1787868680.379939:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.379993:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868680.380153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480256 00000100:00100000:3.0:1787868680.380208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480256 00000100:00100000:3.0:1787868680.380259:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480512 00000100:00100000:3.0:1787868680.380261:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480512 00000100:00100000:3.0:1787868680.380283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868680.380293:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918480256:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787868680.380335:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 40f2da0d-44ae-4ff7-a83f-de7677877c0e@192.168.204.27@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:3.0:1787868680.380387:0:6512:0:(genops.c:1385:class_connect()) connect: client 40f2da0d-44ae-4ff7-a83f-de7677877c0e, cookie 0x2f11f4d3bde2d12d 00000004:00100000:3.0:1787868680.380422:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868680.380577:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dab7f75000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868680.380667:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2402:x1874715918480256:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 373us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868680.380675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868680.380701:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1787868680.380707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918480512:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787868680.380723:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 40f2da0d-44ae-4ff7-a83f-de7677877c0e@192.168.204.27@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:3.0:1787868680.380747:0:6512:0:(genops.c:1385:class_connect()) connect: client 40f2da0d-44ae-4ff7-a83f-de7677877c0e, cookie 0x2f11f4d3bde2d134 00000004:00100000:3.0:1787868680.380761:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868680.380818:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dab7f75800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868680.380842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2402:x1874715918480512:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 134us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868680.380862:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1787868680.382965:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868680.383017:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.383203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480896 00000100:00100000:0.0:1787868680.383216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480896 00000100:00100000:0.0:1787868680.383291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481024 00000100:00100000:0.0:1787868680.383295:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481024 00000100:00100000:0.0:1787868680.383321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:0.0:1787868680.383332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918480896:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868680.383424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918480896:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 94us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.383432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:0.0:1787868680.383449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:0.0:1787868680.383456:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918481024:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868680.383480:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918481024:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.383505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00080000:2.0:1787868680.384358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868680.384366:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868680.387900:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868680.387978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868680.388149:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480768 00000100:00100000:3.0:1787868680.388208:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480768 00000100:00100000:3.0:1787868680.388284:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480640 00000100:00100000:3.0:1787868680.388288:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480640 00000100:00100000:3.0:1787868680.388317:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:3.0:1787868680.388331:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918480768:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787868680.388385:0:10190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868680.388508:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918480768:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 180us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868680.388517:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:3.0:1787868680.388538:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1787868680.388546:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:0:x1874715918480640:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787868680.388559:0:10190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868680.388598:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:0:x1874715918480640:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 52us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868680.388604:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1787868680.389398:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.389554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918480384 00000100:00100000:0.0:1787868680.389562:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918480384 00000100:00100000:0.0:1787868680.389617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1787868680.389627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:0:x1874715918480384:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787868680.389654:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868680.389712:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:0:x1874715918480384:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.389720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00080000:1.0:1787868680.389801:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868680.389808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868680.392618:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868680.392734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481152 00000100:00100000:3.0:1787868680.392747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481152 00000100:00100000:3.0:1787868680.392868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868680.392881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481152:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787868680.393030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481152:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 151us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868680.393070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868680.395558:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.395674:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481280 00000100:00100000:1.0:1787868680.395687:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481280 00000100:00100000:1.0:1787868680.395750:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1787868680.395760:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918481280:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787868680.395805:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 40f2da0d-44ae-4ff7-a83f-de7677877c0e@192.168.204.27@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:1.0:1787868680.395861:0:8430:0:(genops.c:1385:class_connect()) connect: client 40f2da0d-44ae-4ff7-a83f-de7677877c0e, cookie 0x2f11f4d3bde2d13b 00002000:00100000:1.0:1787868680.395877:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 40f2da0d-44ae-4ff7-a83f-de7677877c0e/ffff93d98731e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787868680.395891:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787868680.396017:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787868680.396077:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93d98731b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868680.396213:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2402:x1874715918481280:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 453us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868680.396223:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1787868680.398222:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868680.398377:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481408 00000100:00100000:1.0:1787868680.398390:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481408 00000100:00100000:1.0:1787868680.398452:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1787868680.398462:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874715918481408:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787868680.398508:0:8962:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 40f2da0d-44ae-4ff7-a83f-de7677877c0e@192.168.204.27@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:1.0:1787868680.398563:0:8962:0:(genops.c:1385:class_connect()) connect: client 40f2da0d-44ae-4ff7-a83f-de7677877c0e, cookie 0x2f11f4d3bde2d142 00002000:00100000:1.0:1787868680.398579:0:8962:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 40f2da0d-44ae-4ff7-a83f-de7677877c0e/ffff93d98731a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787868680.398594:0:8962:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787868680.398689:0:8962:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787868680.398757:0:8962:0:(import.c:65:import_set_state_nolock()) ffff93d987318000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868680.400048:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2402:x1874715918481408:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 591us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868680.400119:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787868680.401811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.402197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481536 00000100:00100000:0.0:1787868680.402210:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481536 00000100:00100000:0.0:1787868680.402282:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868680.402295:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481536:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787868680.402410:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481536:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 118us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.402419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1787868680.405619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868680.405740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481664 00000100:00100000:0.0:1787868680.405754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481664 00000100:00100000:0.0:1787868680.405859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1787868680.405873:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481664:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787868680.406026:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787868680.406330:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:8742:x1874715918481664:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 459us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868680.406340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00010000:00010000:1.0:1787868681.314533:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868682.344731:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868683.361339:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868684.388315:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868684.577349:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787868684.577375:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939529984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868684.577451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868684.577524:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939529856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868684.577561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.577668:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529984 00000100:00100000:3.0:1787868684.577676:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529984 00000100:00100000:3.0:1787868684.577730:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787868684.577741:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939529984:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787868684.577766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787868684.577770:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868684.577777:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939530240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.577806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.577810:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939529984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.577817:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868684.577825:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939530752:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.577838:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530240 00000100:00100000:3.0:1787868684.577842:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530240 00000100:00100000:1.0:1787868684.577844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868684.577857:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939531264:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.577865:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530752 00000100:00100000:3.0:1787868684.577867:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530752 00000100:00100000:1.0:1787868684.577899:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.577905:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787868684.577911:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.577917:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868684.577922:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939530368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.577939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.577942:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939530240:12345-0@lo:400:kworker.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.577948:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787868684.577948:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939530880:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.577957:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530368 00000100:00100000:3.0:1787868684.577960:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530368 00000100:00100000:1.0:1787868684.577964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.577987:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787868684.577987:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939531392:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.578000:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939530752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.578027:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939530752:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868684.578035:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939530240:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.578047:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:1.0:1787868684.578047:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813ed00 x1874715939530752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868684.578057:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939530752:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.578058:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787868684.578063:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531264 00000100:00100000:1.0:1787868684.578099:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531264 00000100:00100000:3.0:1787868684.578106:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939530368:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.578112:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787868684.578126:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530880 00000100:00100000:1.0:1787868684.578129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530880 00000100:00100000:1.0:1787868684.578141:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531392 00000100:00100000:1.0:1787868684.578144:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531392 00000100:00100000:0.0:1787868684.578179:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939529856 00000100:00100000:1.0:1787868684.578184:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787868684.578184:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939529856 00000100:00100000:1.0:1787868684.578191:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939531264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868684.578211:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787868684.578218:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939529856:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868684.578221:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939531264:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868684.578227:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868684.578237:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868684.578242:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939530880:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1787868684.578242:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868684.578265:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939530880:12345-0@lo:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868684.578269:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939529856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868684.578270:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787868684.578275:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787868684.578279:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787868684.578284:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578312:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939531392:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868684.578317:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787868684.578337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868684.578341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868684.578343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868684.578351:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939530496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868684.578402:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939531008:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868684.578431:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530496 00000100:00100000:3.0:1787868684.578435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530496 00000100:00100000:3.0:1787868684.578458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787868684.578460:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868684.578464:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.578465:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939530112:0@lo:400:kworker.0 00000100:00100000:0.0:1787868684.578518:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531008 00000100:00100000:0.0:1787868684.578522:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531008 00000100:00100000:0.0:1787868684.578547:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787868684.578553:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939531008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.578807:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939530496:12345-0@lo:400:kworker.0 Request processed in 342us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.578814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787868684.581003:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868684.581072:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939530624:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.581130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868684.581150:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939531136:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.581190:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868684.581233:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939530496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.581260:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868684.581288:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868684.581325:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868684.581351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939530368:0@lo:400:kworker.0 00010000:00080000:1.0:1787868684.581365:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813c000 x1874715939530880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868684.581376:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939530880:0@lo:400:kworker.0 00010000:00080000:1.0:1787868684.581386:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e1c0 x1874715939531392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868684.581393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939531392:0@lo:400:kworker.0 00010000:00080000:1.0:1787868684.581402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e580 x1874715939531264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868684.581457:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530112 00000100:00100000:3.0:1787868684.581465:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530112 00000100:00100000:3.0:1787868684.581510:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787868684.581519:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939530112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.581573:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939530112:12345-0@lo:400:kworker.0 Request processed in 56us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.581580:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787868684.581615:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939530624 00000100:00100000:3.0:1787868684.581618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939530624 00000100:00100000:3.0:1787868684.581662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531136 00000100:00100000:3.0:1787868684.581665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531136 00000100:00100000:3.0:1787868684.581680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787868684.581686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.581733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939530624:12345-0@lo:400:kworker.0 Request processed in 47us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.581739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787868684.581751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787868684.581757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939531136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.581784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939531136:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.581790:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787868684.581805:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868684.581808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868684.581816:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531520 00000100:00100000:3.0:1787868684.581819:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531520 00000100:00100000:3.0:1787868684.581843:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787868684.581849:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939531520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868684.581865:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868684.581907:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939531520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868684.581913:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787868684.581943:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988241680 x1874715939531520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868684.581958:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868684.581969:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939530112:0@lo:400:kworker.0 00000100:00100000:3.0:1787868684.582002:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939530624:0@lo:400:kworker.0 00010000:00080000:3.0:1787868684.582013:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813d680 x1874715939531136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868684.582034:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939531136:0@lo:400:kworker.0 00000100:00100000:1.0:1787868684.582563:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939531264:0@lo:400:kworker.0 00010000:00080000:2.0:1787868684.585918:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830cb40 x1874715939529984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868684.585971:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939529984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868684.585995:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939529856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868684.591330:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939531008:12345-0@lo:400:kworker.0 Request processed in 12766us (12895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868684.591364:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787868684.591489:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939531008:0@lo:400:kworker.0 00000100:00100000:1.0:1787868685.090512:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868685.090536:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939531776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868685.090601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868685.090719:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531776 00000100:00100000:3.0:1787868685.090726:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531776 00000100:00100000:3.0:1787868685.090775:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868685.090784:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939531776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868685.090814:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868685.090853:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939531776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868685.090860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868685.090890:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868685.090898:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939531648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868685.090937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868685.090971:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531648 00000100:00100000:3.0:1787868685.090974:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531648 00000100:00100000:3.0:1787868685.090997:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787868685.091003:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939531648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868685.091023:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868685.091050:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939531648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868685.091056:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1787868685.091259:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882421c0 x1874715939531648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868685.091276:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939531648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868685.091419:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939531776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868685.091566:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939531904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868685.091590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868685.096855:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939531904 00000100:00100000:3.0:1787868685.096884:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939531904 00000100:00100000:3.0:1787868685.096980:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787868685.096992:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939531904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868685.097019:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868685.097110:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939531904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (5517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868685.097118:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787868685.097271:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988303480 x1874715939531904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868685.097293:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939531904:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787868685.409261:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868685.537532:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537572:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537601:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537636:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537665:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537690:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868685.537692:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482048 00000100:00100000:1.0:1787868685.537710:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482048 00000100:00100000:2.0:1787868685.537723:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868685.537783:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482560 00000100:00100000:2.0:1787868685.537793:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482560 00000100:00100000:1.0:1787868685.537794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482304 00000100:00100000:1.0:1787868685.537802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482304 00000100:00100000:1.0:1787868685.537833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481920 00000100:00100000:1.0:1787868685.537837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481920 00000100:00100000:1.0:1787868685.537878:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482176 00000100:00100000:2.0:1787868685.537884:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482432 00000100:00100000:1.0:1787868685.537885:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482176 00000100:00100000:1.0:1787868685.537915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:1.0:1787868685.537926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918482048:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868685.538008:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918482048:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 83us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868685.538018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:1.0:1787868685.538041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:1.0:1787868685.538048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868685.538097:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868685.538104:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:1.0:1787868685.538117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:1.0:1787868685.538125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918481920:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868685.538214:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918481920:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 90us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868685.538223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:1.0:1787868685.538245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:1.0:1787868685.538262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482176:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1787868685.538292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868685.538300:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868685.538304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868685.538315:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482176:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868685.538326:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:1.0:1787868685.538366:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1787868685.538378:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868685.538423:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868685.538430:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1787868685.538669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918481792 00000100:00100000:2.0:1787868685.538671:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482432 00000100:00100000:0.0:1787868685.538680:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918481792 00000100:00100000:2.0:1787868685.538740:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1787868685.538754:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868685.538786:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:0.0:1787868685.538798:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918481792:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1787868685.538819:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868685.538846:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918481792:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868685.538854:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:2.0:1787868685.539021:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918482432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 269us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868685.539031:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000001:00100000:1.0:1787868685.606841:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00100000:1.0:1787868685.611517:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00100000:3.0:1787868685.613483:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00100000:2.0:1787868685.614469:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00010000:00010000:3.0:1787868686.437475:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787868687.135379:0:12181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787868687.457398:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868688.481476:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868689.507352:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868689.699947:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939532032:0@lo:400:kworker.0 00000100:00100000:3.0:1787868689.700033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868689.700200:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532032 00000100:00100000:1.0:1787868689.700219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532032 00000100:00100000:1.0:1787868689.700271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787868689.700282:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868689.700593:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939532288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868689.700631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868689.708923:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939532032:12345-0@lo:400:kworker.0 Request processed in 8631us (8877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868689.708939:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787868689.709755:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939532160:0@lo:400:kworker.0 00000100:00100000:1.0:1787868689.709835:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868689.710387:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939532032:0@lo:400:kworker.0 00000100:00100000:3.0:1787868689.710430:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532160 00000100:00100000:3.0:1787868689.710437:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532160 00000100:00100000:3.0:1787868689.710490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787868689.710500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939532160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868689.710574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939532160:12345-0@lo:400:kworker.0 Request processed in 76us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868689.710581:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787868689.710672:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532288 00000100:00100000:3.0:1787868689.710676:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532288 00000100:00100000:3.0:1787868689.710700:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868689.710720:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939532288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868689.710745:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868689.710798:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939532288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (10166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868689.710806:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868689.710847:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939532544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868689.710878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868689.710903:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532544 00000100:00100000:3.0:1787868689.710907:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532544 00000100:00100000:3.0:1787868689.710958:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787868689.710965:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939532544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868689.710983:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868689.711013:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939532544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868689.711019:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787868689.711034:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787868689.711056:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830d2c0 x1874715939532544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868689.711073:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939532544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868689.711253:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939532160:0@lo:400:kworker.0 00000100:00100000:1.0:1787868689.711275:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939532416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868689.711303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868689.711662:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532416 00000100:00100000:3.0:1787868689.711667:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532416 00000100:00100000:3.0:1787868689.711732:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787868689.711739:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939532416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868689.711751:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868689.711796:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939532416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868689.711813:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868689.712072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939532288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868689.713083:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939532800:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.713135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.713203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532800 00000100:00100000:0.0:1787868689.713209:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532800 00000100:00100000:0.0:1787868689.713247:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787868689.713255:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.713311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939532800:12345-0@lo:400:kworker.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.713318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787868689.713356:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939532800:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.713389:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868689.713395:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939532928:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.713420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.713446:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532928 00000100:00100000:0.0:1787868689.713449:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532928 00000100:00100000:2.0:1787868689.713515:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868689.713530:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939532672:0@lo:400:kworker.0 00000100:00100000:2.0:1787868689.713575:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868689.713601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939532672 00000100:00100000:2.0:1787868689.713605:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939532672 00000100:00100000:2.0:1787868689.713635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787868689.713641:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939532672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868689.713672:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939532672:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868689.713678:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787868689.713711:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939532672:0@lo:400:kworker.0 00010000:00080000:3.0:1787868689.715796:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830c000 x1874715939532416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868689.715824:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939532416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787868689.721216:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868689.721548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868689.722638:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787868689.722656:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.722761:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939532928:12345-0@lo:400:kworker.0 Request processed in 112us (9339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.722769:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787868689.722835:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939532928:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.727959:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939533312:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.728298:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939533056:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.728362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533312 00000100:00100000:0.0:1787868689.728369:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533312 00000100:00100000:0.0:1787868689.728420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533056 00000100:00100000:0.0:1787868689.728423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533056 00000100:00100000:0.0:1787868689.728455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787868689.728466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939533312:12345-0@lo:400:kworker.0 Request processed in 79us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.728564:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787868689.728582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787868689.728588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728618:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939533056:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.728623:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:0.0:1787868689.728662:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988302580 x1874715939533312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868689.728676:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939533312:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728734:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939533440:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.728816:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533440 00000100:00100000:0.0:1787868689.728820:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533440 00000100:00100000:0.0:1787868689.728851:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787868689.728858:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728892:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939533440:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.728899:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787868689.728922:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988302580 x1874715939533440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868689.728933:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939533440:0@lo:400:kworker.0 00010000:00080000:0.0:1787868689.728956:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988301a40 x1874715939533056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868689.728972:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939533056:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.728989:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868689.728996:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939533184:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.729019:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.729037:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533184 00000100:00100000:0.0:1787868689.729040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533184 00000100:00100000:0.0:1787868689.729062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787868689.729068:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.729096:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939533184:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.729102:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787868689.729148:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939533184:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.729184:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939533568:0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.729206:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868689.729225:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533568 00000100:00100000:0.0:1787868689.729228:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533568 00000100:00100000:0.0:1787868689.729253:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787868689.729259:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868689.729286:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939533568:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868689.729292:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787868689.729317:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988302580 x1874715939533568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868689.729326:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939533568:0@lo:400:kworker.0 00000100:00080000:1.0:1787868689.732244:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868689.732254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868689.732258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868690.210595:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868690.210667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868690.210777:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533696 00000100:00100000:3.0:1787868690.210786:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533696 00000100:00100000:3.0:1787868690.210847:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868690.210857:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939533696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868690.210885:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868690.210940:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939533696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.210948:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787868690.211072:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e992c0 x1874715939533696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868690.211090:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868690.213458:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939533824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868690.213531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868690.213792:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533824 00000100:00100000:2.0:1787868690.213801:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533824 00000100:00100000:2.0:1787868690.213868:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787868690.213878:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939533824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868690.213914:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868690.214054:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939533824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868690.214064:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787868690.214259:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939533952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868690.214291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868690.214369:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939533952 00000100:00100000:1.0:1787868690.214374:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939533952 00000100:00100000:1.0:1787868690.214412:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868690.214419:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939533952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868690.214432:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868690.214465:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939533952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868690.214471:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787868690.214549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988302940 x1874715939533952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868690.214567:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939533952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868690.220424:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939533824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787868690.536607:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868690.650078:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650225:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650250:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650285:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650308:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650325:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650346:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868690.650373:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483456 00000100:00100000:3.0:1787868690.650382:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483456 00000100:00100000:3.0:1787868690.650504:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483328 00000100:00100000:3.0:1787868690.650508:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483328 00000100:00100000:3.0:1787868690.650534:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1787868690.650544:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483456:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.650615:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483456:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.650637:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1787868690.650654:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1787868690.650662:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.650701:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.650708:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1787868690.650727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482944 00000100:00100000:3.0:1787868690.650730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482944 00000100:00100000:3.0:1787868690.650752:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483200 00000100:00100000:3.0:1787868690.650755:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483200 00000100:00100000:3.0:1787868690.650782:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482816 00000100:00100000:3.0:1787868690.650784:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482816 00000100:00100000:3.0:1787868690.650798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483072 00000100:00100000:3.0:1787868690.650800:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483072 00000100:00100000:3.0:1787868690.650815:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1787868690.650820:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918482944:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.650870:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918482944:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 48us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.651116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1787868690.651132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1787868690.651140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.651199:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 60us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.651206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1787868690.651218:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787868690.651232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918482816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.651259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918482816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.651265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787868690.651278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:3.0:1787868690.651284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868690.651304:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918483072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868690.651309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00080000:1.0:1787868690.652274:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868690.652286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868690.652289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868690.652292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868690.653774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918482688 00000100:00100000:0.0:1787868690.653788:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918482688 00000100:00100000:1.0:1787868690.654259:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 309 00000100:00100000:1.0:1787868690.654270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918482688:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868690.654346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918482688:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868690.654353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 309 00010000:00010000:0.0:1787868691.553354:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868692.579170:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868693.605327:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868694.626017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868694.818252:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939534336:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868694.818377:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939534848:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868694.818420:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939535360:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868694.818481:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868694.818489:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868694.818528:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939534976:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868694.818579:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939535488:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.818599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.818978:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939534208:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.819009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.819029:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939534720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.819050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.819060:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939535232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.819081:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.819100:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787868694.819105:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939534080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.819133:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.819173:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939534592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.819197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.823148:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.823232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.823261:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.823301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.823332:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868694.823357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868694.825135:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534336 00000100:00100000:0.0:1787868694.825148:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534336 00000100:00100000:0.0:1787868694.825212:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534592 00000100:00100000:0.0:1787868694.825216:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534592 00000100:00100000:0.0:1787868694.825234:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787868694.825242:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939534336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.825370:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868694.825386:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939535872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868694.825428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868694.828956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534848 00000100:00100000:1.0:1787868694.828974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534848 00000100:00100000:1.0:1787868694.829041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535360 00000100:00100000:1.0:1787868694.829044:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535360 00000100:00100000:1.0:1787868694.829058:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534464 00000100:00100000:1.0:1787868694.829061:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534464 00000100:00100000:1.0:1787868694.829073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534208 00000100:00100000:1.0:1787868694.829076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534208 00000100:00100000:1.0:1787868694.829089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534720 00000100:00100000:1.0:1787868694.829091:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534720 00000100:00100000:1.0:1787868694.829104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535232 00000100:00100000:1.0:1787868694.829107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535232 00000100:00100000:1.0:1787868694.829127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787868694.829136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939534848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868694.829303:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939534336:12345-0@lo:400:kworker.0 Request processed in 4059us (10973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868694.829313:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787868694.829337:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787868694.829346:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868694.829400:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939534592:12345-0@lo:400:kworker.0 Request processed in 56us (10201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868694.829406:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787868694.829656:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787868694.829666:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939535360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.829716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939535360:12345-0@lo:400:kworker.0 Request processed in 53us (11275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.829722:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787868694.829748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787868694.829755:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.829794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939534464:12345-0@lo:400:kworker.0 Request processed in 40us (11281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.829800:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787868694.830001:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787868694.830008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830041:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939534208:12345-0@lo:400:kworker.0 Request processed in 34us (11031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830048:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787868694.830069:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787868694.830075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939534720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939534720:12345-0@lo:400:kworker.0 Request processed in 31us (11055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787868694.830124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787868694.830130:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939535232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830189:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939535232:12345-0@lo:400:kworker.0 Request processed in 58us (11106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787868694.830220:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534976 00000100:00100000:2.0:1787868694.830225:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534976 00000100:00100000:2.0:1787868694.830249:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535488 00000100:00100000:2.0:1787868694.830252:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535488 00000100:00100000:2.0:1787868694.830264:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535104 00000100:00100000:2.0:1787868694.830267:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535104 00000100:00100000:2.0:1787868694.830279:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535616 00000100:00100000:2.0:1787868694.830281:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535616 00000100:00100000:2.0:1787868694.830293:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787868694.830299:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939534976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830330:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939534976:12345-0@lo:400:kworker.0 Request processed in 31us (11777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830336:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787868694.830346:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787868694.830352:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830380:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939535488:12345-0@lo:400:kworker.0 Request processed in 28us (11780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830395:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787868694.830408:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787868694.830414:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830444:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535104:12345-0@lo:400:kworker.0 Request processed in 31us (7213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830449:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787868694.830459:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787868694.830464:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.830490:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535616:12345-0@lo:400:kworker.0 Request processed in 26us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830494:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787868694.830518:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535744 00000100:00100000:2.0:1787868694.830522:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535744 00000100:00100000:2.0:1787868694.830536:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939535872 00000100:00100000:2.0:1787868694.830538:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939535872 00000100:00100000:2.0:1787868694.830549:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787868694.830554:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868694.830576:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868694.830607:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939535744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868694.830613:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787868694.830763:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787868694.830784:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939535872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868694.830795:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868694.830832:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939535872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (5404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868694.830838:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787868694.830865:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939534080 00000100:00100000:0.0:1787868694.830868:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939534080 00000100:00100000:0.0:1787868694.830895:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787868694.830901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939534080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868694.830930:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939534080:12345-0@lo:400:kworker.0 Request processed in 29us (11796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868694.830935:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787868694.831121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939536000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868694.831188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787868694.831236:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8f840 x1874715939535872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868694.831270:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939535872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868694.831316:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939534464:0@lo:400:kworker.0 00010000:00080000:2.0:1787868694.831327:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e9bc00 x1874715939534976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868694.831336:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939534976:0@lo:400:kworker.0 00010000:00080000:2.0:1787868694.831344:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1de00 x1874715939535488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868694.831352:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939535488:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.831362:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939534336:0@lo:400:kworker.0 00000100:00100000:0.0:1787868694.831411:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536000 00000100:00100000:0.0:1787868694.831416:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536000 00000100:00100000:0.0:1787868694.831445:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787868694.831452:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939536000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868694.831477:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868694.831519:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939536000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868694.831526:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787868694.834144:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939534848:12345-0@lo:400:kworker.0 Request processed in 4996us (15728us total) trans 0 rc 0/0 00000100:00080000:0.0:1787868694.834235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868694.834242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868694.834257:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868694.834261:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868694.834530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00080000:1.0:1787868694.834603:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830cb40 x1874715939535744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868694.834639:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868694.834656:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939534080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.834668:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939534592:0@lo:400:kworker.0 00010000:00080000:1.0:1787868694.834687:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e992c0 x1874715939535104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868694.834709:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535104:0@lo:400:kworker.0 00010000:00080000:1.0:1787868694.834725:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1d2c0 x1874715939535616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868694.834746:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939535616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.834762:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939534208:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.834784:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939534720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868694.834797:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939535232:0@lo:400:kworker.0 00010000:00080000:2.0:1787868694.835209:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e98000 x1874715939534848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868694.835219:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939534848:0@lo:400:kworker.0 00010000:00080000:2.0:1787868694.835232:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1cb40 x1874715939535360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868694.835239:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939535360:0@lo:400:kworker.0 00000100:00100000:2.0:1787868694.835292:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939536000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868695.330076:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868695.330106:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939536128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868695.330188:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868695.330254:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536128 00000100:00100000:0.0:1787868695.330261:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536128 00000100:00100000:0.0:1787868695.330301:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787868695.330310:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939536128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868695.330347:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868695.330385:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939536128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868695.330392:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1787868695.330425:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9883012c0 x1874715939536128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868695.330444:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939536128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868695.335240:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868695.335266:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939536256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868695.335351:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868695.335569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536256 00000100:00100000:2.0:1787868695.335577:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536256 00000100:00100000:2.0:1787868695.335628:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787868695.335638:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939536256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868695.335688:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868695.335754:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939536256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868695.335767:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787868695.335811:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93368f00 x1874715939536256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868695.335827:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939536256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868695.338432:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939536384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868695.338518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868695.338721:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536384 00000100:00100000:0.0:1787868695.338728:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536384 00000100:00100000:0.0:1787868695.338805:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787868695.338817:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939536384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868695.338850:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868695.338910:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939536384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868695.338917:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787868695.339197:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939536384:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787868695.650591:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868695.773938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.773987:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774023:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774057:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774080:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774099:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868695.774198:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484352 00000100:00100000:3.0:1787868695.774208:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484352 00000100:00100000:0.0:1787868695.774221:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483840 00000100:00100000:0.0:1787868695.774229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483840 00000100:00100000:3.0:1787868695.774282:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484224 00000100:00100000:3.0:1787868695.774286:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484224 00000100:00100000:3.0:1787868695.774311:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1787868695.774323:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868695.774338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484096 00000100:00100000:0.0:1787868695.774356:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484096 00000100:00100000:0.0:1787868695.774380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483712 00000100:00100000:0.0:1787868695.774383:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483712 00000100:00100000:0.0:1787868695.774396:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483968 00000100:00100000:0.0:1787868695.774398:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483968 00000100:00100000:3.0:1787868695.774412:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 91us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868695.774418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:3.0:1787868695.774425:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:0.0:1787868695.774430:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918483840:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868695.774450:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1787868695.774470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918483840:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868695.774473:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868695.774483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:0.0:1787868695.774502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:0.0:1787868695.774510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484096:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868695.774516:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 46us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868695.774525:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1787868695.774542:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918484096:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868695.774552:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:2.0:1787868695.774602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918483584 00000100:00100000:2.0:1787868695.774608:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918483584 00000100:00100000:2.0:1787868695.774640:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 311 00000100:00100000:2.0:1787868695.774647:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918483584:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868695.774689:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918483584:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868695.774696:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 311 00000100:00080000:2.0:1787868695.774745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868695.774749:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868695.774751:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868695.774753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868695.774847:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:0.0:1787868695.774864:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:0.0:1787868695.774872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918483968:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868695.774911:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918483968:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868695.774918:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:3.0:1787868695.778626:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918483712:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868695.782415:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918483712:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 3800us (8316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868695.782436:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 177 00000020:00000004:3.0:1787868696.550580:0:12498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787868696.551276:0:12498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868696.684458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868697.697583:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868698.721379:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868699.016473:0:12595:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868699.017304:0:12595:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868699.748069:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868699.937724:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868699.937750:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939536512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868699.937828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.937947:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536512 00000100:00100000:0.0:1787868699.937957:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536512 00000100:00100000:0.0:1787868699.938033:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787868699.938046:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939536512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868699.938082:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868699.938179:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939536512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.938188:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1787868699.938215:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da932b0000 x1874715939536512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868699.938236:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939536512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787868699.938274:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868699.938491:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939537024:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.938541:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939536640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868699.938604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.938617:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868699.938646:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939537536:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.938647:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939537152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.938662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537024 00000100:00100000:3.0:1787868699.938668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537024 00000100:00100000:1.0:1787868699.938677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.938696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868699.938719:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939538048:0@lo:400:kworker.0 00000100:00100000:1.0:1787868699.938742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868699.938747:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939536896:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.938785:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939537664:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.938816:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939536768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868699.938837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.938853:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939537280:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.938906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536640 00000100:00100000:0.0:1787868699.938910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536640 00000100:00100000:0.0:1787868699.938937:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537152 00000100:00100000:0.0:1787868699.938940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537152 00000100:00100000:0.0:1787868699.938953:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868699.938960:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939536640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868699.938986:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868699.939043:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939536640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.939049:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868699.939062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868699.939068:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939537152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.939095:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939537152:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.939114:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787868699.939353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868699.939394:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939537408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868699.939429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868699.939446:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939537920:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.941015:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536896 00000100:00100000:0.0:1787868699.941027:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536896 00000100:00100000:0.0:1787868699.941090:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787868699.941099:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939536896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.941210:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939536896:12345-0@lo:400:kworker.0 Request processed in 111us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.941216:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787868699.941280:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537408 00000100:00100000:0.0:1787868699.941295:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537408 00000100:00100000:0.0:1787868699.941323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787868699.941330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939537408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.941366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939537408:12345-0@lo:400:kworker.0 Request processed in 37us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.941372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787868699.958703:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537536 00000100:00100000:3.0:1787868699.958720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537536 00000100:00100000:3.0:1787868699.958794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538048 00000100:00100000:3.0:1787868699.958799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538048 00000100:00100000:3.0:1787868699.958822:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787868699.958846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939537024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.958966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939537024:12345-0@lo:400:kworker.0 Request processed in 135us (20362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868699.959102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787868699.959122:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787868699.959143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939537536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.959194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939537536:12345-0@lo:400:kworker.0 Request processed in 53us (20516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868699.959201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787868699.959213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787868699.959219:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.959248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939538048:12345-0@lo:400:kworker.0 Request processed in 31us (20507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868699.959254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1787868699.959278:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868699.959283:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868699.959320:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939537024:0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.959335:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939537536:0@lo:400:kworker.0 00010000:00080000:3.0:1787868699.959348:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1de00 x1874715939538048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868699.959373:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939538048:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.961936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.961997:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939538176:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.962057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.962180:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939536640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868699.962193:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939537152:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.962230:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537664 00000100:00100000:0.0:1787868699.962236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537664 00000100:00100000:0.0:1787868699.962288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787868699.962298:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939537664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.962352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939537664:12345-0@lo:400:kworker.0 Request processed in 56us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868699.962738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00080000:0.0:1787868699.962787:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed092c0 x1874715939537664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868699.962800:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939537664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.963939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538176 00000100:00100000:3.0:1787868699.963950:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538176 00000100:00100000:3.0:1787868699.964014:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868699.964025:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.964114:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939538176:12345-0@lo:400:kworker.0 Request processed in 92us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868699.964122:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787868699.964148:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939536768 00000100:00100000:3.0:1787868699.964151:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939536768 00000100:00100000:3.0:1787868699.964221:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868699.964227:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939536768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868699.964242:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868699.964275:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939536768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (25437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868699.964281:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787868699.964298:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868699.964302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868699.964304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868699.964321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868699.964378:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939536896:0@lo:400:kworker.0 00000100:00100000:3.0:1787868699.964393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939537408:0@lo:400:kworker.0 00010000:00080000:0.0:1787868699.965032:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1ed00 x1874715939538176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868699.965045:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939538176:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.969151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.969226:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939537792:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.969282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868699.969305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.969325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787868699.969374:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da932b1e00 x1874715939536768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868699.969410:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939536768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868699.969433:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537920 00000100:00100000:1.0:1787868699.969441:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537920 00000100:00100000:0.0:1787868699.969451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537280 00000100:00100000:0.0:1787868699.969456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537280 00000100:00080000:1.0:1787868699.969476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868699.969506:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787868699.969516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939537280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.969643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939537280:12345-0@lo:400:kworker.0 Request processed in 129us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868699.969714:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939537792 00000100:00100000:2.0:1787868699.969718:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939537792 00000100:00100000:2.0:1787868699.969746:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538304 00000100:00100000:2.0:1787868699.969749:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538304 00000100:00100000:2.0:1787868699.969778:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787868699.969785:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939537792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868699.969821:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939537792:12345-0@lo:400:kworker.0 Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868699.969827:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787868699.969842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787868699.969847:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939538304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868699.969872:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939538304:12345-0@lo:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868699.969877:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868699.974892:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1787868699.974945:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868699.975056:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939537920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868699.975180:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939537920:12345-0@lo:400:kworker.0 Request processed in 255us (10857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868699.975189:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787868699.975261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939537920:0@lo:400:kworker.0 00000100:00100000:1.0:1787868699.975342:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939537280:0@lo:400:kworker.0 00010000:00080000:1.0:1787868699.975361:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0b0c0 x1874715939537792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868699.975373:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939537792:0@lo:400:kworker.0 00010000:00080000:1.0:1787868699.975385:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1d2c0 x1874715939538304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868699.975393:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787868699.981647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787868700.451109:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939538432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868700.451109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939538560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868700.455916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868700.456827:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868700.456877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538432 00000100:00100000:2.0:1787868700.456887:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538432 00000100:00100000:2.0:1787868700.456943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787868700.456953:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939538432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868700.456996:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868700.457093:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538560 00000100:00100000:3.0:1787868700.457099:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538560 00000100:00100000:2.0:1787868700.457108:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939538432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868700.457119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787868700.457136:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868700.457147:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939538560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868700.457189:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868700.457728:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939538432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868700.457783:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939538560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868700.457792:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1787868700.457836:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988807840 x1874715939538560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868700.457853:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939538560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868700.465670:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939538688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868700.465754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868700.467512:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538688 00000100:00100000:2.0:1787868700.467526:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538688 00000100:00100000:2.0:1787868700.467599:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787868700.467610:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939538688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868700.467637:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868700.467714:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939538688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868700.467722:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1787868700.468733:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6e9a940 x1874715939538688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868700.468756:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939538688:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787868700.771934:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868700.890919:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.890998:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891036:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891076:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891100:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891118:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891142:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868700.891218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484736 00000100:00100000:3.0:1787868700.891227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484736 00000100:00100000:3.0:1787868700.891286:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484992 00000100:00100000:3.0:1787868700.891289:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484992 00000100:00100000:3.0:1787868700.891303:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484608 00000100:00100000:3.0:1787868700.891305:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484608 00000100:00100000:3.0:1787868700.891318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484864 00000100:00100000:3.0:1787868700.891320:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484864 00000100:00100000:3.0:1787868700.891349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1787868700.891360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918484736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868700.891435:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918484736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868700.891443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1787868700.891460:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:3.0:1787868700.891467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918484992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868700.891504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918484992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868700.891511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1787868700.892133:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:1.0:1787868700.892147:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918484608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868700.892208:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918484608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 66us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868700.892214:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:3.0:1787868700.892452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:3.0:1787868700.892462:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918484864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868700.892497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918484864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868700.892505:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1787868700.895840:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918484480 00000100:00100000:0.0:1787868700.895855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918484480 00000100:00100000:0.0:1787868700.895919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 313 00000100:00100000:0.0:1787868700.895929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918484480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868700.896000:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918484480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 73us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868700.896008:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 313 00000100:00080000:1.0:1787868700.896511:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868700.896710:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868700.901315:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485120 00000100:00100000:3.0:1787868700.901332:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485120 00000100:00100000:3.0:1787868700.901965:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485248 00000100:00100000:3.0:1787868700.901970:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485248 00000100:00100000:3.0:1787868700.902006:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787868700.902016:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2402:x1874715918485120:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:3.0:1787868700.902056:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d13b 00000100:00080000:2.0:1787868700.902838:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868700.902844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868700.903875:0:8431:0:(import.c:65:import_set_state_nolock()) ffff93d98731b800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787868700.906105:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868700.908276:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1787868700.908296:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2402:x1874715918485248:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:0.0:1787868700.908344:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d142 00000100:00080000:0.0:1787868700.908356:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93d987318000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787868700.908411:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787868700.908616:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+2:2402:x1874715918485248:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 328us (17472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868700.908626:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00010000:00010000:2.0:1787868700.910629:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787868700.912422:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787868700.912887:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+2:2402:x1874715918485120:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 10866us (21760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868700.912901:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:0.0:1787868701.793456:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787868702.128392:0:12693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787868702.130896:0:12693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868702.817320:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868703.852635:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868704.468426:0:12790:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868704.469049:0:12790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868704.865316:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868705.057839:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939539200:0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.057942:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939538816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868705.058020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939539072:0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.058267:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868705.058321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539200 00000100:00100000:0.0:1787868705.058329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539200 00000100:00100000:0.0:1787868705.058387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787868705.058408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939539200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.062077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868705.062174:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939539328:0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.062226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868705.062245:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939539840:0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.062340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868705.062361:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939540352:0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.062384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868705.062489:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868705.062498:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939540736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868705.062524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868705.062643:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538816 00000100:00100000:1.0:1787868705.062654:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538816 00000100:00100000:1.0:1787868705.062705:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540736 00000100:00100000:3.0:1787868705.062777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.062814:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939539584:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.062838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.062854:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939540096:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.062873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.062889:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939540608:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.062909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.062929:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787868705.062936:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939538944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868705.062959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.062976:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939539456:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.063019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.063031:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939539968:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.063049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.063067:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939540480:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.063087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.063113:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539328 00000100:00100000:3.0:1787868705.063117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539328 00000100:00100000:3.0:1787868705.063137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539584 00000100:00100000:3.0:1787868705.063139:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539584 00000100:00100000:3.0:1787868705.063148:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939538944 00000100:00100000:3.0:1787868705.063150:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939538944 00000100:00100000:3.0:1787868705.063179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787868705.063186:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.063239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939539328:12345-0@lo:400:kworker.0 Request processed in 54us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868705.063246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787868705.063337:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540736 00000100:00100000:1.0:1787868705.063362:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787868705.063368:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939538816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868705.063391:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868705.064775:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939539712:0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.064815:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539072 00000100:00100000:0.0:1787868705.064825:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539072 00000100:00100000:0.0:1787868705.064884:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787868705.064896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939539072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.064960:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939539072:12345-0@lo:400:kworker.0 Request processed in 67us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.064967:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787868705.064981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868705.065005:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939540224:0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.065109:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868705.065173:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540096 00000100:00100000:2.0:1787868705.065179:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540096 00000100:00100000:2.0:1787868705.065204:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540608 00000100:00100000:2.0:1787868705.065207:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540608 00000100:00100000:2.0:1787868705.065222:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539968 00000100:00100000:2.0:1787868705.065225:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539968 00000100:00100000:2.0:1787868705.065236:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540480 00000100:00100000:2.0:1787868705.065238:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540480 00000100:00100000:2.0:1787868705.065253:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787868705.065274:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939540096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.065315:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939540096:12345-0@lo:400:kworker.0 Request processed in 42us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868705.065321:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787868705.065333:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787868705.065339:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939540608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.065367:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939540608:12345-0@lo:400:kworker.0 Request processed in 28us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868705.065373:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787868705.065384:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787868705.065406:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539840 00000100:00100000:0.0:1787868705.065412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539840 00000100:00100000:0.0:1787868705.065434:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540352 00000100:00100000:0.0:1787868705.065437:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540352 00000100:00100000:0.0:1787868705.065452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539456 00000100:00100000:0.0:1787868705.065455:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539456 00000100:00100000:2.0:1787868705.065462:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939539968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.065470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939539712 00000100:00100000:0.0:1787868705.065475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939539712 00000100:00100000:0.0:1787868705.065507:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540224 00000100:00100000:0.0:1787868705.065510:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540224 00000100:00100000:2.0:1787868705.065513:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939539968:12345-0@lo:400:kworker.0 Request processed in 122us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868705.065522:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787868705.065534:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787868705.065540:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787868705.065544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939539840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.065552:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939540480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.065590:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939540480:12345-0@lo:400:kworker.0 Request processed in 43us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868705.065596:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787868705.065654:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939539840:12345-0@lo:400:kworker.0 Request processed in 112us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787868705.065676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787868705.065683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.065716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939540352:12345-0@lo:400:kworker.0 Request processed in 33us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787868705.065734:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787868705.065749:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939539456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.065781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939539456:12345-0@lo:400:kworker.0 Request processed in 34us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065787:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787868705.065798:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787868705.065804:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.065837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939539712:12345-0@lo:400:kworker.0 Request processed in 33us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787868705.065852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787868705.065856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.065884:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939540224:12345-0@lo:400:kworker.0 Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787868705.065925:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939539200:12345-0@lo:400:kworker.0 Request processed in 7528us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.065932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787868705.066528:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787868705.066539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868705.066584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939539584:12345-0@lo:400:kworker.0 Request processed in 48us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868705.066591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787868705.066691:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787868705.066695:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939539200:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.066704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939538944:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868705.066716:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939539712:0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.066730:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939540224:0@lo:400:kworker.0 00000004:00000024:3.0:1787868705.066733:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868705.066773:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939538944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868705.066780:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787868705.066831:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939538944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868705.066844:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939539456:0@lo:400:kworker.0 00010000:00080000:3.0:1787868705.066858:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab70092c0 x1874715939539968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868705.066886:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab70092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939539968:0@lo:400:kworker.0 00010000:00080000:3.0:1787868705.066902:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbe580 x1874715939540480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868705.066911:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939540480:0@lo:400:kworker.0 00000100:00100000:1.0:1787868705.067052:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939538816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3683us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868705.067061:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787868705.067079:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787868705.067087:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939540736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868705.067104:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868705.067130:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939540736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868705.067135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787868705.067186:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868705.067192:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868705.067194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868705.067198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787868705.067225:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0b840 x1874715939540736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868705.067242:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939540736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868705.068388:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939539072:0@lo:400:kworker.0 00010000:00080000:1.0:1787868705.069046:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed0b480 x1874715939538816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868705.069067:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939538816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868705.069087:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939539328:0@lo:400:kworker.0 00010000:00080000:1.0:1787868705.069099:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7008780 x1874715939539840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868705.069107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939539840:0@lo:400:kworker.0 00010000:00080000:1.0:1787868705.069119:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbed00 x1874715939540352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868705.069151:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939540352:0@lo:400:kworker.0 00000100:00100000:3.0:1787868705.069348:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939539584:0@lo:400:kworker.0 00010000:00080000:3.0:1787868705.069363:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700bc00 x1874715939540096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868705.069371:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939540096:0@lo:400:kworker.0 00010000:00080000:3.0:1787868705.069381:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd2c0 x1874715939540608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868705.069389:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939540608:0@lo:400:kworker.0 00000100:00100000:2.0:1787868705.569433:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868705.569483:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939540864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868705.569594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.569807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540864 00000100:00100000:3.0:1787868705.569815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540864 00000100:00100000:3.0:1787868705.569870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787868705.569880:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939540864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868705.569915:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868705.569968:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939540864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868705.569975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787868705.570021:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939540864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868705.570599:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868705.570636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.570679:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939540992 00000100:00100000:3.0:1787868705.570683:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939540992 00000100:00100000:3.0:1787868705.570713:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868705.570726:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939540992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868705.570736:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939541120:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868705.570746:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868705.570765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868705.570773:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868705.570779:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868705.570789:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541120 00000100:00100000:3.0:1787868705.570792:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541120 00000100:00100000:3.0:1787868705.570806:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787868705.570812:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939541120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868705.570822:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868705.570871:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939541120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868705.570877:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1787868705.570899:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd680 x1874715939540992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787868705.570899:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbc000 x1874715939541120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868705.570915:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868705.570915:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939541120:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787868705.889975:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868706.012096:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868706.012131:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868706.012206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868706.012225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868706.012245:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868706.012310:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485376 00000100:00100000:3.0:1787868706.012319:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485376 00000100:00100000:3.0:1787868706.012397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:3.0:1787868706.012415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918485376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868706.012519:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918485376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868706.012526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:0.0:1787868706.013098:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485504 00000100:00100000:0.0:1787868706.013104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485504 00000100:00100000:0.0:1787868706.013147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485760 00000100:00100000:0.0:1787868706.013180:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485760 00000100:00100000:0.0:1787868706.013196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485632 00000100:00100000:0.0:1787868706.013198:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485632 00000100:00100000:0.0:1787868706.013208:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918485888 00000100:00100000:0.0:1787868706.013210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918485888 00000100:00100000:0.0:1787868706.013222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1787868706.013229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918485504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868706.013270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918485504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868706.013276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1787868706.013289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:0.0:1787868706.013295:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918485760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868706.013313:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918485760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 18us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868706.013318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:0.0:1787868706.013326:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:0.0:1787868706.013331:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918485632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868706.013348:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918485632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 17us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868706.013354:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:0.0:1787868706.013362:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:0.0:1787868706.013367:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918485888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868706.013398:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918485888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (1152us total) trans 0 rc 0/0 00000100:00080000:3.0:1787868706.013522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868706.013527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868706.013610:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000001:00100000:3.0:1787868706.597200:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000020:00000080:3.0:1787868706.597211:0:9508:0:(genops.c:885:class_export_put()) final put ffff93d98731a800/40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000020:00000080:3.0:1787868706.597239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98731a800/40f2da0d-44ae-4ff7-a83f-de7677877c0e for lustre-OST0001 00000020:00000080:3.0:1787868706.597297:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987318000 for lustre-OST0001 00000001:00100000:3.0:1787868706.597771:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000020:00000080:3.0:1787868706.597776:0:8423:0:(genops.c:885:class_export_put()) final put ffff93d98731e000/40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000020:00000080:0.0:1787868706.597822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98731e000/40f2da0d-44ae-4ff7-a83f-de7677877c0e for lustre-OST0000 00000020:00000080:0.0:1787868706.597858:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d98731b800 for lustre-OST0000 00000020:00000004:1.0:1787868706.713824:0:12887:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868706.714145:0:12887:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787868706.913628:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868707.943241:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868708.962016:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868709.988041:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868710.178306:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939541376:0@lo:400:kworker.0 00000100:00100000:3.0:1787868710.178425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868710.178583:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939541632:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.178635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868710.178689:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939541504:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.178731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868710.178798:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939541888:0@lo:400:kworker.0 00000100:00100000:3.0:1787868710.178823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868710.179055:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939541248:0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.179094:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.179413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541376 00000100:00100000:0.0:1787868710.179422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541376 00000100:00100000:0.0:1787868710.179470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541632 00000100:00100000:0.0:1787868710.179473:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541632 00000100:00100000:2.0:1787868710.179579:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541504 00000100:00100000:2.0:1787868710.179583:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541504 00000100:00100000:2.0:1787868710.179619:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787868710.179629:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939541504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.179978:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939541504:12345-0@lo:400:kworker.0 Request processed in 349us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868710.179986:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787868710.180013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541888 00000100:00100000:2.0:1787868710.180017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541888 00000100:00100000:2.0:1787868710.180044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787868710.180051:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939541376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.180084:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939541376:12345-0@lo:400:kworker.0 Request processed in 35us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868710.180106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787868710.180121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787868710.180127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939541888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.180176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939541888:12345-0@lo:400:kworker.0 Request processed in 49us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868710.180182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787868710.180196:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868710.180236:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939541504:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.180244:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939542016:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.180271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.180342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542016 00000100:00100000:0.0:1787868710.180346:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542016 00000100:00100000:0.0:1787868710.180367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787868710.180372:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939541632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.180416:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939541632:12345-0@lo:400:kworker.0 Request processed in 44us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.180422:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787868710.180435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787868710.180441:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939542016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.180467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939542016:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.180473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787868710.181332:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939541888:0@lo:400:kworker.0 00000100:00100000:3.0:1787868710.181345:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939542400:0@lo:400:kworker.0 00000100:00100000:3.0:1787868710.181396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868710.181442:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939542912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868710.181468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868710.181513:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939541376:0@lo:400:kworker.0 00000100:00100000:3.0:1787868710.181588:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542912 00000100:00100000:3.0:1787868710.181593:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542912 00000100:00100000:3.0:1787868710.181638:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868710.181645:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939542912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868710.182084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542400 00000100:00100000:0.0:1787868710.182089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542400 00000100:00100000:0.0:1787868710.182114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787868710.182121:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939542400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.182185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939542400:12345-0@lo:400:kworker.0 Request processed in 64us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.182191:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787868710.182219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541248 00000100:00100000:0.0:1787868710.182223:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541248 00000100:00100000:0.0:1787868710.182293:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787868710.182310:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939541248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.182345:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939541248:12345-0@lo:400:kworker.0 Request processed in 37us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.182351:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:0.0:1787868710.182377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868710.182393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868710.182457:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939541632:0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.182465:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939542144:0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.182504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.182525:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939542656:0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.182544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.182571:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939543168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868710.182594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.182612:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868710.182618:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939543040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868710.182639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.183046:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542144 00000100:00100000:0.0:1787868710.183051:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542144 00000100:00100000:0.0:1787868710.183088:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542656 00000100:00100000:0.0:1787868710.183091:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542656 00000100:00100000:0.0:1787868710.183113:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787868710.183121:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939542144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.183188:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939542144:12345-0@lo:400:kworker.0 Request processed in 68us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.183194:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787868710.183210:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787868710.183227:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939542656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.183260:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939542656:12345-0@lo:400:kworker.0 Request processed in 35us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.183266:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787868710.183287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868710.183291:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787868710.183311:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1680 x1874715939542144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868710.183323:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939542144:0@lo:400:kworker.0 00010000:00080000:0.0:1787868710.183334:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd851680 x1874715939542656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868710.183342:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939542656:0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.183391:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543168 00000100:00100000:0.0:1787868710.183394:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543168 00000100:00100000:0.0:1787868710.183412:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543040 00000100:00100000:0.0:1787868710.183414:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543040 00000100:00100000:0.0:1787868710.183434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787868710.183440:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939543168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868710.183461:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787868710.183567:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787868710.183608:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939542912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1963us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868710.183616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868710.183689:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939542912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868710.183703:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939542400:0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.183975:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939543168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 534us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.183982:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787868710.183996:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787868710.184003:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939543040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868710.184014:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868710.184037:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939543040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.184051:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787868710.184067:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868710.184172:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939541248:0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184182:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939541760:0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868710.184234:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939542272:0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868710.184272:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939542784:0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868710.184327:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542272 00000100:00100000:1.0:1787868710.184331:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542272 00000100:00100000:1.0:1787868710.184354:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542784 00000100:00100000:1.0:1787868710.184357:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542784 00000100:00100000:1.0:1787868710.184389:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787868710.184397:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939542272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184431:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939542272:12345-0@lo:400:kworker.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868710.184444:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787868710.184457:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787868710.184463:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939542784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184502:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939542784:12345-0@lo:400:kworker.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868710.184508:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787868710.184528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939541760 00000100:00100000:1.0:1787868710.184532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939541760 00000100:00100000:1.0:1787868710.184552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787868710.184558:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939541760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868710.184589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939541760:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868710.184595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787868710.184608:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868710.184627:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939541760:0@lo:400:kworker.0 00010000:00080000:1.0:1787868710.184637:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c3840 x1874715939542272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868710.184646:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939542272:0@lo:400:kworker.0 00010000:00080000:1.0:1787868710.184655:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd851e00 x1874715939542784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868710.184663:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939542784:0@lo:400:kworker.0 00010000:00080000:3.0:1787868710.185127:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393e940 x1874715939543040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868710.185144:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939543040:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787868710.185183:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393cf00 x1874715939543168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868710.185195:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939543168:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787868710.185307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c0f00 x1874715939542016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868710.185318:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939542016:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.185326:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939542528:0@lo:400:kworker.0 00000100:00100000:2.0:1787868710.185359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868710.185547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939542528 00000100:00100000:0.0:1787868710.185552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939542528 00000100:00100000:0.0:1787868710.185644:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787868710.185652:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939542528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868710.185716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939542528:12345-0@lo:400:kworker.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868710.185724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00080000:3.0:1787868710.185967:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd8503c0 x1874715939542528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868710.185977:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939542528:0@lo:400:kworker.0 00000100:00080000:1.0:1787868710.186195:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868710.690193:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939543296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868710.690265:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868710.690783:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868710.690848:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543296 00000100:00100000:2.0:1787868710.690857:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543296 00000100:00100000:2.0:1787868710.690904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787868710.690913:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939543296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868710.690951:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868710.693288:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939543552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868710.693354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868710.693419:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543552 00000100:00100000:3.0:1787868710.693426:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543552 00000100:00100000:3.0:1787868710.693486:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787868710.693496:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939543552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868710.693537:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868710.693579:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939543552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868710.693587:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787868710.693626:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393e940 x1874715939543552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868710.693644:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939543552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868710.694641:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939543424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868710.694686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868710.696856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939543296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5934us (6581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868710.696870:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787868710.702095:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543424 00000100:00100000:3.0:1787868710.702112:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543424 00000100:00100000:2.0:1787868710.702583:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868710.702609:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939543424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868710.702641:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868710.702727:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939543424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (8039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868710.702734:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787868710.703113:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939543296:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787868710.703180:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393cf00 x1874715939543424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868710.703194:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939543424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787868711.012660:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868711.105052:0:13033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787868711.143733:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868711.143784:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868711.143920:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486016 00000100:00100000:0.0:1787868711.143930:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486016 00000100:00100000:0.0:1787868711.143981:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:0.0:1787868711.143990:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918486016:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868711.144059:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918486016:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 70us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868711.144066:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:0.0:1787868711.144099:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486272 00000100:00100000:0.0:1787868711.144103:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486272 00000100:00100000:0.0:1787868711.144141:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:0.0:1787868711.144148:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918486272:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868711.144212:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918486272:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 64us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868711.144218:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00080000:0.0:1787868711.144682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868711.144786:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868711.145048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868711.145076:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868711.145095:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486528 00000100:00100000:3.0:1787868711.145099:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486528 00000100:00100000:3.0:1787868711.145131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486144 00000100:00100000:3.0:1787868711.145133:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486144 00000100:00100000:3.0:1787868711.145143:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486400 00000100:00100000:3.0:1787868711.145145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486400 00000100:00100000:3.0:1787868711.145177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:3.0:1787868711.145186:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918486528:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868711.145237:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918486528:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868711.145244:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:0.0:1787868711.145357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:0.0:1787868711.145378:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918486144:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868711.145795:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918486144:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868711.145879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:0.0:1787868711.145903:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:0.0:1787868711.145911:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918486400:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868711.145945:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918486400:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868711.145951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00080000:0.0:1787868711.145974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868711.145979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787868712.037225:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868713.059580:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868714.084269:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.109092:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787868715.150349:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7f8a2720 20000000:00000080:3.0:1787868715.150374:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93dabeb0e800 uarg=0000000000000000 20000000:01000000:3.0:1787868715.150431:0:13182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787868715.150439:0:13182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787868715.150447:0:13182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787868715.151976:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787868715.152367:0:13182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787868715.166036:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787868715.166082:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166106:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166114:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166122:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166133:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166141:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166148:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166208:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166608:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166630:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 12 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.166649:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543680:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868715.166807:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.166818:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 23 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.166828:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543808:0@lo:104: 00000100:00100000:1.0:1787868715.170051:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.170239:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939543808 00000100:00100000:0.0:1787868715.170252:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939543808 00000100:00100000:0.0:1787868715.170344:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787868715.170358:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939543808:12345-0@lo:104: 00010000:00010000:0.0:1787868715.170514:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.170607:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868715.170615:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939543808:12345-0@lo:104: Request processed in 262us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.170624:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1787868715.170704:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868715.170714:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.170723:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868715.170728:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.170737:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868715.170745:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868715.170752:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868715.170800:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.170807:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868715.170838:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.170872:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3a00/0x2f11f4d3bde2d10a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.170890:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.170892:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.170894:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868715.170913:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939544064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868715.171128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.171294:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544064 00000100:00100000:0.0:1787868715.171303:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544064 00010000:00010000:0.0:1787868715.171335:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868715.171454:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787868715.171466:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939544064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868715.171480:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868715.171487:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868715.171672:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868715.171737:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486656 00000100:00100000:2.0:1787868715.171743:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486656 00010000:00010000:2.0:1787868715.171769:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 13 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868715.171796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1787868715.171804:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918486656:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868715.171814:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868715.171820:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 13 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.171829:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.171849:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 13 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.171894:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.171932:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543936:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868715.171940:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868715.172034:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.172054:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.172064:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544192:0@lo:104: 00000100:00100000:0.0:1787868715.172310:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939544064:12345-0@lo:103:ldlm_bl.0 Request processed in 846us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.172318:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787868715.172380:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939544064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868715.172532:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 13 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.172549:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868715.172577:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918486656:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 775us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868715.172585:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1787868715.172803:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868715.172866:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544192 00000100:00100000:2.0:1787868715.172883:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544192 00000100:00100000:2.0:1787868715.172940:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787868715.172950:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544192:12345-0@lo:104: 00010000:00010000:2.0:1787868715.172966:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173014:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868715.173021:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544192:12345-0@lo:104: Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868715.173027:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787868715.173045:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868715.173051:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173060:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868715.173064:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173075:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868715.173082:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868715.173089:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868715.173123:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173130:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868715.173180:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173195:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2000/0x2f11f4d3bde2d0f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173214:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.173216:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.173218:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868715.173235:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939544320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868715.173276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868715.173333:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544320 00000100:00100000:2.0:1787868715.173338:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544320 00010000:00010000:2.0:1787868715.173357:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868715.173626:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868715.173636:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939544320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868715.173648:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868715.173655:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.173666:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.173679:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 24 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.173692:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544448:0@lo:104: 00000100:00100000:1.0:1787868715.173726:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787868715.173775:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 24 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.173796:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868715.173830:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939544320:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868715.173837:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868715.173880:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939544320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868715.173929:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.173938:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 23 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.173947:0:13182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544576:0@lo:104: 00000100:00100000:1.0:1787868715.173970:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868715.182592:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544576 00000100:00100000:2.0:1787868715.182621:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544576 00000100:00100000:3.0:1787868715.183039:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787868715.183053:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544576:12345-0@lo:104: 00010000:00010000:3.0:1787868715.183079:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183396:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787868715.183404:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544576:12345-0@lo:104: Request processed in 354us (9432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868715.183412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787868715.183437:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00010000:00010000:2.0:1787868715.183481:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868715.183489:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.183499:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868715.183504:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.183515:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868715.183523:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868715.183529:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486784 10000000:01000000:2.0:1787868715.183530:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787868715.183535:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486784 00010000:00010000:3.0:1787868715.183560:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 13 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868715.183584:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1787868715.183591:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918486784:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868715.183596:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.183614:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868715.183640:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183648:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868715.183648:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870a00/0x2f11f4d3bde2d0d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183654:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 13 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183666:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 13 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.183666:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.183668:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.183670:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868715.183706:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939544704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868715.183710:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868715.183750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868715.183757:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918486784:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 167us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868715.183764:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1787868715.183776:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544704 00000100:00100000:3.0:1787868715.183779:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544704 00010000:00010000:3.0:1787868715.183792:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 24 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868715.183808:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868715.183814:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939544704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868715.183824:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868715.183828:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 24 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183837:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 24 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868715.183847:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868715.183887:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939544704:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868715.183893:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868715.184887:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544448 00000100:00100000:0.0:1787868715.184898:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544448 00000100:00100000:0.0:1787868715.184975:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787868715.184987:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544448:12345-0@lo:104: 00010000:00010000:0.0:1787868715.185005:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.185049:0:13182:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385cd80 going to sleep for 11 seconds 00010000:00010000:1.0:1787868715.185087:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2d126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feec6 expref: 12 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.185102:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543680:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868715.186342:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868715.186359:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13182:x1874715939544448:12345-0@lo:104: Request processed in 1372us (12630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.186371:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787868715.187187:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d2a00/0x2f11f4d3bde2d111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d10a expref: 23 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868715.187188:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939544704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868715.187237:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868715.187246:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.187257:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868715.187261:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.187272:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868715.187280:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868715.187297:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868715.187353:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.187361:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787868715.187365:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543808:0@lo:104: 00010000:00010000:1.0:1787868715.187391:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d3000/0x2f11f4d3bde2d103 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee87 expref: 11 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868715.187400:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.187404:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939543936:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868715.187416:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd871800/0x2f11f4d3bde2d0e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d0ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.187424:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d0fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0f5 expref: 22 pid: 6506 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868715.187437:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544192:0@lo:104: 00010000:00010000:2.0:1787868715.187440:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868715.187445:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868715.187450:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544448:0@lo:104: 00010000:00010000:2.0:1787868715.187458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868715.187463:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d3e00/0x2f11f4d3bde2d0e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0d9 expref: 21 pid: 6505 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868715.187467:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868715.187474:0:13182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1874715939544576:0@lo:104: 00000100:00100000:2.0:1787868715.187487:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939544832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868715.187521:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868715.187768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.187875:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544832 00000100:00100000:0.0:1787868715.187888:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544832 00010000:00010000:0.0:1787868715.188300:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 21 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868715.188374:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868715.188387:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3639:x1874715939544832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868715.188406:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868715.188412:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 21 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188425:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 21 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188444:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871200/0x2f11f4d3bde2d0ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d0e7 expref: 21 pid: 6507 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188461:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188472:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188490:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188497:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188505:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188512:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.188527:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868715.189222:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.189240:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.189367:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868715.189376:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.191259:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.191302:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a400/0x2f11f4d3bde2d149 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868715.191339:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868715.191480:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3639:x1874715939544832:12345-0@lo:103:ldlm_bl.0 Request processed in 3089us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.191495:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787868715.191742:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939544832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787868715.302587:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939545344:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302714:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939545856:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302778:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939546368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302825:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787868715.302831:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939544960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868715.302855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302875:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939545472:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302918:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939545984:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302951:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939546496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.302970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.302995:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939545088:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303017:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303034:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939545600:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303054:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303072:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939546112:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303119:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787868715.303124:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939545216:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303189:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939545728:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303223:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939546240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868715.303296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545344 00000100:00100000:1.0:1787868715.303306:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545344 00000100:00100000:1.0:1787868715.303349:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545088 00000100:00100000:1.0:1787868715.303352:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545088 00000100:00100000:1.0:1787868715.303362:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545600 00000100:00100000:1.0:1787868715.303364:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545600 00000100:00100000:1.0:1787868715.303388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546112 00000100:00100000:1.0:1787868715.303391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546112 00000100:00100000:1.0:1787868715.303402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545728 00000100:00100000:1.0:1787868715.303405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545728 00000100:00100000:1.0:1787868715.303416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546240 00000100:00100000:1.0:1787868715.303418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546240 00000100:00100000:1.0:1787868715.303434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787868715.303442:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939545344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939545344:12345-0@lo:400:kworker.0 Request processed in 55us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787868715.303525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787868715.303531:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939545088:12345-0@lo:400:kworker.0 Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787868715.303580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787868715.303586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939545600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303613:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939545600:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787868715.303637:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787868715.303642:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939546112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939546112:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787868715.303684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787868715.303690:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939545728:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787868715.303731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787868715.303736:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939546240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303762:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939546240:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787868715.303784:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545856 00000100:00100000:1.0:1787868715.303787:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545856 00000100:00100000:1.0:1787868715.303805:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546368 00000100:00100000:1.0:1787868715.303808:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546368 00000100:00100000:1.0:1787868715.303818:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545984 00000100:00100000:1.0:1787868715.303820:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545984 00000100:00100000:1.0:1787868715.303829:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546496 00000100:00100000:1.0:1787868715.303831:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546496 00000100:00100000:1.0:1787868715.303843:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787868715.303849:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939545856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303903:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939545856:12345-0@lo:400:kworker.0 Request processed in 54us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303919:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787868715.303931:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787868715.303937:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939546368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.303967:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939546368:12345-0@lo:400:kworker.0 Request processed in 31us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.303973:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787868715.303983:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868715.303988:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304012:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939545984:12345-0@lo:400:kworker.0 Request processed in 24us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.304017:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868715.304028:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787868715.304034:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939546496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304059:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939546496:12345-0@lo:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.304063:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787868715.304087:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939544960 00000100:00100000:1.0:1787868715.304090:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939544960 00000100:00100000:1.0:1787868715.304120:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787868715.304127:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939544960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868715.304150:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868715.304206:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939544960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.304212:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787868715.304230:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545472 00000100:00100000:1.0:1787868715.304239:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545472 00000100:00100000:1.0:1787868715.304264:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939545216 00000100:00100000:1.0:1787868715.304267:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939545216 00000100:00100000:1.0:1787868715.304279:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787868715.304298:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939545472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304350:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939545472:12345-0@lo:400:kworker.0 Request processed in 53us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.304356:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787868715.304369:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787868715.304375:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939545216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304401:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939545216:12345-0@lo:400:kworker.0 Request processed in 27us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868715.304406:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787868715.304443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868715.304447:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868715.304449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868715.304451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868715.304485:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939545216:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304500:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c503c0 x1874715939545728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304511:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939545728:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304521:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700c780 x1874715939546240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304531:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939546240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304543:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939545088:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304565:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939545600:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304576:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939546112:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304616:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c50780 x1874715939544960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304632:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939544960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868715.304642:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939545472:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab700de00 x1874715939545984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304659:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939545984:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304669:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f94780 x1874715939546496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304677:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939546496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868715.304688:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939545344:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304697:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c52d00 x1874715939545856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304704:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939545856:0@lo:400:kworker.0 00010000:00080000:1.0:1787868715.304715:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f96d00 x1874715939546368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.304722:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939546368:0@lo:400:kworker.0 00000100:00100000:3.0:1787868715.305366:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868715.305381:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939546624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868715.305431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868715.305500:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546624 00000100:00100000:2.0:1787868715.305505:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546624 00000100:00100000:2.0:1787868715.305547:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787868715.305555:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939546624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868715.305585:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868715.305631:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939546624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868715.305637:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787868715.305713:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939546624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868715.309776:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868715.309804:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939546752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868715.309911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.310021:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546752 00000100:00100000:0.0:1787868715.310029:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546752 00000100:00100000:0.0:1787868715.310089:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787868715.310099:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939546752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868715.310122:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868715.310201:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939546752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.310209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1787868715.310314:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd680 x1874715939546752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868715.310336:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939546752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868715.809449:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868715.809500:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939546880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868715.809605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.809937:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939546880 00000100:00100000:0.0:1787868715.809951:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939546880 00000100:00100000:0.0:1787868715.810013:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787868715.810036:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939546880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868715.810073:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868715.810211:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939546880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.810244:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1787868715.810906:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93091a40 x1874715939546880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868715.810975:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939546880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868715.812363:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868715.812412:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868715.812672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868715.812794:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547008 00000100:00100000:3.0:1787868715.812801:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547008 00000100:00100000:3.0:1787868715.813004:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787868715.813014:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939547008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868715.813038:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868715.813090:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939547008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868715.813097:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787868715.813476:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939547136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868715.814073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868715.814183:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547136 00000100:00100000:0.0:1787868715.814188:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547136 00000100:00100000:0.0:1787868715.814228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787868715.814235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939547136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868715.814264:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868715.814318:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939547136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868715.814325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1787868715.814545:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c3840 x1874715939547008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868715.814567:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868715.814802:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939547136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787868716.142884:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868716.253630:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.253679:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.253713:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.253733:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.253760:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.253792:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487040 00000100:00100000:1.0:1787868716.253805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487040 00000100:00100000:1.0:1787868716.253877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487296 00000100:00100000:1.0:1787868716.253881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487296 00000100:00100000:1.0:1787868716.253900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487168 00000100:00100000:1.0:1787868716.253903:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487168 00000100:00100000:1.0:1787868716.253917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487424 00000100:00100000:1.0:1787868716.253919:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487424 00000100:00100000:1.0:1787868716.253937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:1.0:1787868716.253949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918487040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868716.254058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2406:x1874715918487040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 111us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.254066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:1.0:1787868716.254090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:1.0:1787868716.254097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918487296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868716.254122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918487296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.254150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:1.0:1787868716.254201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1787868716.254208:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918487168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868716.254235:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918487168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.254241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1787868716.254252:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:1.0:1787868716.254258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918487424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868716.254295:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918487424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.254302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00080000:1.0:1787868716.254330:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868716.254335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868716.254599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918486912 00000100:00100000:0.0:1787868716.254605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918486912 00000100:00100000:0.0:1787868716.254657:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 318 00000100:00100000:0.0:1787868716.254666:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2406:x1874715918486912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868716.254705:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2406:x1874715918486912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.254712:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 318 10000000:01000000:3.0:1787868716.577593:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787868716.577605:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dabec41000 from 7 10000000:01000000:3.0:1787868716.577613:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868716.577685:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.577700:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.577714:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868716.577751:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.577851:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868716.578096:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868716.585702:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547264 00000100:00100000:0.0:1787868716.585734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547264 00000100:00100000:0.0:1787868716.586272:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787868716.586294:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939547264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868716.586333:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868716.587332:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d150 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.587392:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.587409:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.587422:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:0.0:1787868716.587554:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1268us (9701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.587564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787868716.587718:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868716.587745:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.587756:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868716.587867:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.587912:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868716.588960:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868716.589323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547392 00000100:00100000:2.0:1787868716.589335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547392 00000100:00100000:2.0:1787868716.589412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787868716.589423:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.589653:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868716.589661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787868716.591822:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.591985:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.592292:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868716.592345:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787868716.592368:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547520 00000100:00100000:2.0:1787868716.592375:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547520 00000100:00100000:2.0:1787868716.592431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787868716.592443:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.592597:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868716.592607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787868716.592677:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787868716.594845:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787868716.595034:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787868716.595074:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787868716.595100:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868716.595116:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868716.595131:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787868716.595196:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab5b24800 from 7 10000000:01000000:2.0:1787868716.595201:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868716.595272:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868716.595282:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868716.595296:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868716.595329:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.595428:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868716.595495:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787868716.595564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547648 00000100:00100000:0.0:1787868716.595576:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547648 00000100:00100000:0.0:1787868716.595643:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787868716.595655:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939547648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868716.595673:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868716.595691:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d15e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.595723:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.595738:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.595749:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787868716.595923:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939547648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.595945:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787868716.596717:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868716.596749:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.596763:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868716.596888:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.597039:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868716.597106:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868716.598839:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547776 00000100:00100000:2.0:1787868716.598863:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547776 00000100:00100000:2.0:1787868716.599049:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787868716.599062:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939547776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.601850:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939547776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2776us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868716.601871:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787868716.604016:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.604227:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.604382:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868716.604443:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868716.606763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939547904 00000100:00100000:3.0:1787868716.606783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939547904 00000100:00100000:3.0:1787868716.606868:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787868716.606881:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939547904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.607113:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939547904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868716.607121:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787868716.607273:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939547904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787868716.612901:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787868716.614465:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787868716.614510:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787868716.614527:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.614542:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868716.614555:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787868716.614558:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daaf704800 from 7 10000000:01000000:3.0:1787868716.614561:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868716.614631:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.614641:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868716.614654:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868716.615887:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.616017:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868716.616091:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868716.617571:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548032 00000100:00100000:0.0:1787868716.617592:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548032 00000100:00100000:0.0:1787868716.617686:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787868716.617713:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939548032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868716.617740:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868716.617771:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d16c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.617821:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.617836:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.617849:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286400, rc 0) 00000100:00100000:0.0:1787868716.617993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 284us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.618004:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787868716.618055:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868716.618084:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.618098:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868716.618273:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.618319:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868716.618371:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868716.619082:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548160 00000100:00100000:0.0:1787868716.619090:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548160 00000100:00100000:0.0:1787868716.619146:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787868716.619172:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.619379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.619388:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787868716.619728:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.619788:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.619881:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868716.619934:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868716.622142:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548288 00000100:00100000:0.0:1787868716.622199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548288 00000100:00100000:0.0:1787868716.622290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787868716.622304:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.622547:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.622555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787868716.622608:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787868716.625177:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787868716.625793:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787868716.625840:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868716.625857:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.625875:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868716.625889:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868716.625892:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05d8800 from 7 10000000:01000000:0.0:1787868716.625896:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868716.625948:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.625957:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.625971:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868716.626007:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.626115:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868716.626216:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987ec96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868716.626219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548416 00000100:00100000:1.0:1787868716.626230:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548416 00000100:00100000:1.0:1787868716.626312:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787868716.626325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939548416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868716.627037:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868716.627064:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d17a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.627100:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.627115:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.627128:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b400, rc 0) 00000100:00100000:1.0:1787868716.627932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939548416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1593us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.627948:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787868716.630905:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868716.630970:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.630986:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868716.631122:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.631247:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868716.631323:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987ec96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868716.631532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548544 00000100:00100000:2.0:1787868716.631543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548544 00000100:00100000:2.0:1787868716.631608:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787868716.631621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939548544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.631813:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939548544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868716.631822:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787868716.632877:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.632952:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.633031:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868716.634678:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987ec96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868716.648140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548672 00000100:00100000:1.0:1787868716.648183:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548672 00000100:00100000:1.0:1787868716.648278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787868716.648293:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939548672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868716.649150:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939548672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 855us (16113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.649225:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787868716.649633:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939548672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787868716.653247:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787868716.653423:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787868716.653461:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787868716.653478:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868716.653492:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868716.704035:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868716.704123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487552 00000100:00100000:0.0:1787868716.704137:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487552 00000100:00100000:0.0:1787868716.704238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 331 00000100:00100000:0.0:1787868716.704252:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:6180:x1874715918487552:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868716.704288:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868716.704436:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963feef7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.704483:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.704497:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868716.704533:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868716.704647:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487552:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 398us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.704655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 331 00000100:00100000:2.0:1787868716.715382:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868716.716303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487680 00000100:00100000:2.0:1787868716.716318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487680 00000100:00100000:2.0:1787868716.716401:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 332 00000100:00100000:2.0:1787868716.716415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487680:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868716.716627:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487680:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 215us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868716.716636:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 332 00000100:00100000:0.0:1787868716.724796:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868716.724844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487808 00000100:00100000:0.0:1787868716.724858:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487808 00000100:00100000:0.0:1787868716.724926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 333 00000100:00100000:0.0:1787868716.724938:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487808:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868716.725138:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487808:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868716.725147:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 333 00000100:00100000:3.0:1787868716.747764:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868716.748034:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918487936 00000100:00100000:1.0:1787868716.748051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918487936 00000100:00100000:1.0:1787868716.748141:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:1.0:1787868716.748176:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918487936:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868716.748206:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868716.748235:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963feefe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.748308:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.748321:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868716.748334:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b000, rc 0) 00000100:00100000:1.0:1787868716.748435:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918487936:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 282us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868716.748442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:2.0:1787868716.765668:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868716.765822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488064 00000100:00100000:3.0:1787868716.765836:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488064 00000100:00100000:3.0:1787868716.765911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 335 00000100:00100000:3.0:1787868716.765925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918488064:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.766137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918488064:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 214us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868716.766147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 335 00000100:00100000:1.0:1787868716.773827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868716.773916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488192 00000100:00100000:3.0:1787868716.773930:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488192 00000100:00100000:3.0:1787868716.775206:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:3.0:1787868716.775227:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918488192:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868716.775459:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918488192:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 239us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868716.775469:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 336 00010000:00010000:2.0:1787868717.155046:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868718.177446:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868719.202947:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868720.235228:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787868720.290133:0:13382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787868720.426273:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426427:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939549440:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426485:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939549952:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426533:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939550464:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426588:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787868720.426595:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939549056:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426644:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939549568:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426686:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939550080:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868720.426747:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549440 00000100:00100000:3.0:1787868720.426755:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549440 00000100:00100000:3.0:1787868720.426805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787868720.426816:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939549440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.426879:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939549440:12345-0@lo:400:kworker.0 Request processed in 64us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.426888:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787868720.426917:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549952 00000100:00100000:3.0:1787868720.426921:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549952 00000100:00100000:3.0:1787868720.426972:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550464 00000100:00100000:3.0:1787868720.426983:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550464 00000100:00100000:3.0:1787868720.427009:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787868720.427016:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427050:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939549952:12345-0@lo:400:kworker.0 Request processed in 35us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.427055:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787868720.427066:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787868720.427071:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427097:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939550464:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.427103:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787868720.427123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549056 00000100:00100000:3.0:1787868720.427127:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549056 00000100:00100000:3.0:1787868720.427150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549568 00000100:00100000:3.0:1787868720.427152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549568 00000100:00100000:3.0:1787868720.427198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550080 00000100:00100000:3.0:1787868720.427201:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550080 00000100:00100000:3.0:1787868720.427217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787868720.427222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427253:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939549056:12345-0@lo:400:kworker.0 Request processed in 30us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.427259:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787868720.427271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787868720.427277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939549568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939549568:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.427308:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787868720.427326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787868720.427332:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939550080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939550080:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.427366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1787868720.427388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868720.427391:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868720.427393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868720.427452:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939549056:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427464:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939549568:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427474:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939550080:0@lo:400:kworker.0 00000100:00100000:3.0:1787868720.427483:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939549440:0@lo:400:kworker.0 00010000:00080000:3.0:1787868720.427494:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b840 x1874715939549952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868720.427504:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939549952:0@lo:400:kworker.0 00010000:00080000:3.0:1787868720.427512:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733bc00 x1874715939550464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868720.427521:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939550464:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.428995:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868720.429058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429096:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939549312:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429140:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429229:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939550336:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429248:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429269:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787868720.429275:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939549184:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429310:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429338:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939550208:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.429434:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548928 00000100:00100000:2.0:1787868720.429440:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548928 00000100:00100000:2.0:1787868720.429488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787868720.429497:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939548928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429538:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939548928:12345-0@lo:400:kworker.0 Request processed in 43us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.429545:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787868720.429574:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549184 00000100:00100000:2.0:1787868720.429577:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549184 00000100:00100000:2.0:1787868720.429601:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787868720.429606:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939549184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429646:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939549184:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.429654:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787868720.429694:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939549184:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549312 00000100:00100000:2.0:1787868720.429739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549312 00000100:00100000:2.0:1787868720.429768:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549696 00000100:00100000:2.0:1787868720.429772:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549696 00000100:00100000:2.0:1787868720.429798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550208 00000100:00100000:2.0:1787868720.429801:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550208 00000100:00100000:2.0:1787868720.429824:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787868720.429830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939549312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939549312:12345-0@lo:400:kworker.0 Request processed in 46us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.429882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787868720.429895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787868720.429903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939549696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868720.429926:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939549312:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429937:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939549696:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.429943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787868720.429956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787868720.429962:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939550208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.429986:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939550208:12345-0@lo:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.429991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787868720.430008:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939549824 00000100:00100000:2.0:1787868720.430011:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939549824 00010000:00080000:1.0:1787868720.430032:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da98b80b40 x1874715939549696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868720.430035:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550336 00000100:00100000:2.0:1787868720.430039:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550336 00000100:00100000:1.0:1787868720.430050:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.430061:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787868720.430067:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939549824:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787868720.430145:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733a580 x1874715939550208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868720.430322:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939548800 00000100:00100000:3.0:1787868720.430327:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939548800 00000100:00100000:3.0:1787868720.430353:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787868720.430359:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939548800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868720.430516:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868720.430587:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939550208:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.430602:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939549824:12345-0@lo:400:kworker.0 Request processed in 532us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.430612:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1787868720.430612:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987339e00 x1874715939549824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868720.430626:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.430630:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787868720.430641:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939550336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868720.430697:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939550336:12345-0@lo:400:kworker.0 Request processed in 58us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.430703:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787868720.430729:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939550592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868720.430758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.430791:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550592 00000100:00100000:2.0:1787868720.430794:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550592 00010000:00080000:1.0:1787868720.430806:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987338b40 x1874715939550336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868720.430822:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787868720.430832:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939550592:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868720.430837:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939550336:0@lo:400:kworker.0 00000004:00000024:2.0:1787868720.431012:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868720.431057:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939550592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 227us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868720.431064:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787868720.431085:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868720.431089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868720.431091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868720.431118:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939548928:0@lo:400:kworker.0 00000100:00100000:1.0:1787868720.431191:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939550592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868720.432616:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868720.432634:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939550720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868720.432692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868720.432758:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787868720.432767:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787868720.433235:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550720 00000100:00100000:1.0:1787868720.433243:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550720 00000100:00100000:3.0:1787868720.433616:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939548800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3254us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.433638:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787868720.433659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787868720.433667:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939550720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868720.433687:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868720.433718:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939550720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868720.433724:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1787868720.434047:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbed00 x1874715939550720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868720.434068:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939550720:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787868720.434093:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e1680 x1874715939548800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868720.434105:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868720.929434:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868720.929463:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939550848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868720.929676:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868720.929838:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550848 00000100:00100000:1.0:1787868720.929848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550848 00000100:00100000:1.0:1787868720.929909:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787868720.929918:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939550848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868720.929962:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868720.930009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939550848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868720.930017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787868720.930277:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939550848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868720.931622:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868720.931644:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939550976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868720.931704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868720.932435:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868720.932448:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939551104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868720.932483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868720.932550:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939550976 00000100:00100000:0.0:1787868720.932557:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939550976 00000100:00100000:0.0:1787868720.932603:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551104 00000100:00100000:0.0:1787868720.932606:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551104 00000100:00100000:0.0:1787868720.932622:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787868720.932629:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939550976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868720.932655:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868720.932690:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939550976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868720.932696:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787868720.932742:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787868720.932748:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939551104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868720.932758:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868720.932780:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939551104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868720.932785:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1787868720.934756:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733bc00 x1874715939550976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868720.934786:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939550976:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787868720.937183:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbd2c0 x1874715939551104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868720.937212:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939551104:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787868721.249423:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868721.369439:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868721.369481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868721.369511:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868721.369546:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868721.369569:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868721.369652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488576 00000100:00100000:1.0:1787868721.369663:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488576 00000100:00100000:1.0:1787868721.369729:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488832 00000100:00100000:1.0:1787868721.369733:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488832 00000100:00100000:1.0:1787868721.369767:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488448 00000100:00100000:1.0:1787868721.369770:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488448 00000100:00100000:1.0:1787868721.369782:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488704 00000100:00100000:1.0:1787868721.369785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488704 00000100:00100000:1.0:1787868721.369801:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:1.0:1787868721.369810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918488576:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868721.369889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918488576:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868721.369897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:1.0:1787868721.369915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1787868721.369921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918488832:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868721.369957:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918488832:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868721.370032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1787868721.370047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:1.0:1787868721.370053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918488448:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868721.370076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918488448:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868721.370082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:1.0:1787868721.370091:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:1.0:1787868721.370095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918488704:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868721.370113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918488704:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 18us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868721.370119:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:3.0:1787868721.370509:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488320 00000100:00100000:3.0:1787868721.370515:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488320 00000100:00100000:3.0:1787868721.370558:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 338 00000100:00100000:3.0:1787868721.370567:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918488320:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868721.370603:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918488320:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868721.370610:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 338 00000100:00080000:0.0:1787868721.370747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868721.370752:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787868722.276859:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868723.297343:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868724.322309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868725.345741:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868725.537320:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868725.537397:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868725.537507:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551232 00000100:00100000:2.0:1787868725.537516:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551232 00000100:00100000:2.0:1787868725.537571:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787868725.537581:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939551232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868725.537611:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868725.537660:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939551232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868725.537668:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787868725.537697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787868725.537728:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0ed00 x1874715939551232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868725.537746:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868725.537764:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868725.537771:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939551360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868725.537796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868725.539001:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868725.540453:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551360 00000100:00100000:3.0:1787868725.540483:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551360 00000100:00100000:3.0:1787868725.540582:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868725.540595:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939551360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868725.540627:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868725.540749:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939551360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868725.540758:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1787868725.540812:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882e12c0 x1874715939551360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868725.540854:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939551360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868725.541935:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939551616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.542006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868725.542123:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939551488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868725.542151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868725.542203:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551488 00000100:00100000:1.0:1787868725.542210:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551488 00000100:00100000:1.0:1787868725.542256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787868725.542265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939551488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868725.542304:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868725.542367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939551488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.542374:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787868725.542417:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939551488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868725.544785:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.544890:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868725.545219:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551616 00000100:00100000:0.0:1787868725.545234:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551616 00000100:00100000:0.0:1787868725.545580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551744 00000100:00100000:0.0:1787868725.545586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551744 00000100:00100000:0.0:1787868725.545638:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787868725.545649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939551744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787868725.547222:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868725.555018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939551744:12345-0@lo:400:kworker.0 Request processed in 9354us (10111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868725.555041:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787868725.555523:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787868725.555542:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939551616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868725.555639:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939551616:12345-0@lo:400:kworker.0 Request processed in 102us (13634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868725.555648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787868725.555702:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939551616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.556343:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.556382:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868725.556397:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939551872:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.556486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868725.557269:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939551872 00000100:00100000:2.0:1787868725.557278:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939551872 00000100:00100000:2.0:1787868725.557331:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787868725.557341:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939551872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868725.557419:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939551872:12345-0@lo:400:kworker.0 Request processed in 81us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868725.557426:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787868725.558244:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939551872:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.563228:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939552000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.563346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868725.563787:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552000 00000100:00100000:1.0:1787868725.563798:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552000 00000100:00100000:1.0:1787868725.563865:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787868725.563877:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939552000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.563969:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939552000:12345-0@lo:400:kworker.0 Request processed in 94us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.563977:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787868725.564053:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939552000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.564991:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939552128:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.565077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868725.565448:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868725.565544:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939552256:0@lo:400:kworker.0 00000100:00100000:3.0:1787868725.565615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868725.565755:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939552384:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.565872:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868725.565883:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939552512:0@lo:400:kworker.0 00000100:00100000:3.0:1787868725.566038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868725.566050:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939552640:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.567242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868725.571737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552128 00000100:00100000:1.0:1787868725.571753:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552128 00000100:00100000:1.0:1787868725.571841:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552256 00000100:00100000:1.0:1787868725.571846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552256 00000100:00100000:1.0:1787868725.571863:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552512 00000100:00100000:1.0:1787868725.571866:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552512 00000100:00100000:1.0:1787868725.571893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787868725.571906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939552128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.572016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939552128:12345-0@lo:400:kworker.0 Request processed in 114us (6949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.572762:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787868725.572803:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787868725.572820:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939552256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.572886:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939552256:12345-0@lo:400:kworker.0 Request processed in 74us (7271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.572893:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787868725.572905:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787868725.572926:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939552512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.572962:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939552512:12345-0@lo:400:kworker.0 Request processed in 37us (5727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.572968:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:1.0:1787868725.573013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868725.573018:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787868725.573371:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733ad00 x1874715939552512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868725.573389:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939552512:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.573405:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939552128:0@lo:400:kworker.0 00000100:00100000:3.0:1787868725.573690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868725.573691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787868725.573798:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733a580 x1874715939552256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868725.573811:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552384 00000100:00100000:0.0:1787868725.573817:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939552256:0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.573822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552384 00000100:00100000:1.0:1787868725.573880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787868725.573889:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939552384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868725.573952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939552384:12345-0@lo:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868725.573960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1787868725.573979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868725.574020:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939552384:0@lo:400:kworker.0 00000100:00100000:3.0:1787868725.574145:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868725.574442:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939552768:0@lo:400:kworker.0 00000100:00100000:3.0:1787868725.574503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868725.574984:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552640 00000100:00100000:2.0:1787868725.574992:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552640 00000100:00080000:3.0:1787868725.575112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868725.575862:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552768 00000100:00100000:2.0:1787868725.575872:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552768 00000100:00100000:2.0:1787868725.575925:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787868725.575936:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939552640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868725.576075:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939552640:12345-0@lo:400:kworker.0 Request processed in 141us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868725.576093:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787868725.576113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787868725.576119:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939552768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868725.576152:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939552768:12345-0@lo:400:kworker.0 Request processed in 34us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868725.576398:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1787868725.576615:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b840 x1874715939552640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868725.576636:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939552640:0@lo:400:kworker.0 00000100:00080000:3.0:1787868725.576744:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787868725.576860:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733ad00 x1874715939552768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868725.576874:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939552768:0@lo:400:kworker.0 00000100:00100000:2.0:1787868726.053517:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868726.053548:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939552896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868726.053625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868726.054150:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939553024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868726.054350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868726.054398:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939552896 00000100:00100000:2.0:1787868726.054406:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939552896 00000100:00100000:2.0:1787868726.054457:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787868726.054468:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939552896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868726.054499:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868726.054547:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939552896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.054554:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787868726.054577:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553024 00000100:00100000:2.0:1787868726.054587:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553024 00000100:00100000:2.0:1787868726.054616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787868726.054623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939553024:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1787868726.055301:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0fc00 x1874715939552896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868726.055321:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939552896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868726.055370:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939553152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868726.055409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868726.055458:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553152 00000100:00100000:3.0:1787868726.055462:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553152 00000100:00100000:3.0:1787868726.055488:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868726.055496:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939553152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868726.055509:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868726.055542:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939553152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868726.055550:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1787868726.055585:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733ad00 x1874715939553152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868726.055599:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939553152:0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1787868726.058153:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868726.059844:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939553024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5213us (5485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868726.059858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787868726.060599:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939553024:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787868726.222854:0:13532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:12:04 (1787868724) === 00010000:00010000:0.0:1787868726.370232:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868726.491945:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.491987:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.492020:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868726.492120:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918488960 00000100:00100000:1.0:1787868726.492131:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918488960 00000100:00100000:1.0:1787868726.492219:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 340 00000100:00100000:1.0:1787868726.492230:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918488960:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868726.492321:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918488960:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868726.492329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 340 00000100:00100000:2.0:1787868726.492755:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489216 00000100:00100000:2.0:1787868726.492760:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489216 00000100:00100000:2.0:1787868726.492812:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489472 00000100:00100000:2.0:1787868726.492815:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489472 00000100:00100000:2.0:1787868726.492841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1787868726.492847:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918489216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868726.492890:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918489216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.492897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1787868726.492910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1787868726.492917:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918489472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868726.492942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918489472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.492948:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1787868726.493547:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.493582:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.493612:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489088 00000100:00100000:2.0:1787868726.493616:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489088 00000100:00100000:2.0:1787868726.493641:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489344 00000100:00100000:2.0:1787868726.493644:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489344 00000100:00100000:2.0:1787868726.493660:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:2.0:1787868726.493667:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918489088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868726.493705:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918489088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.493722:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:2.0:1787868726.493735:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:2.0:1787868726.493742:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918489344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868726.493782:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918489344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.493788:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00080000:1.0:1787868726.494548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868726.494554:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868726.522146:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.525688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489728 00000100:00100000:2.0:1787868726.525704:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489728 00000100:00100000:2.0:1787868726.525773:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1787868726.525786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:666039a7-1461-4e99-8c4e-10237114565a+6:10517:x1874715918489728:12345-192.168.204.27@tcp:700:mkdir.0 00000100:00100000:2.0:1787868726.525894:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:666039a7-1461-4e99-8c4e-10237114565a+6:10517:x1874715918489728:12345-192.168.204.27@tcp:700:mkdir.0 Request processed in 112us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.525903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1787868726.526097:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.526397:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489600 00000100:00100000:2.0:1787868726.526401:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489600 00000100:00100000:2.0:1787868726.526441:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1787868726.526450:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918489600:12345-192.168.204.27@tcp:41:mkdir.0 00000004:00000024:2.0:1787868726.526478:0:10190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868726.526553:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918489600:12345-192.168.204.27@tcp:41:mkdir.0 Request processed in 103us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.526560:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868726.531468:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.531570:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918489984 00000100:00100000:3.0:1787868726.531581:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918489984 00000100:00100000:3.0:1787868726.531652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787868726.531662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:10517:x1874715918489984:12345-192.168.204.27@tcp:36:mkdir.0 00010000:00010000:3.0:1787868726.531719:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868726.531788:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dac20fec00/0x2f11f4d3bde2d038 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee72 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531807:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316800) 00010000:00010000:3.0:1787868726.531819:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868726.531910:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531926:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531936:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531967:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531974:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.531996:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533037:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533056:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533076:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868726.533093:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079fd2105 reply state 00000000c129fb27 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533112:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:3.0:1787868726.533116:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868726.533118:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787868726.533125:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868726.533132:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533139:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533146:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.533152:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868726.534405:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.534417:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.534431:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:3.0:1787868726.534434:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868726.534439:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.534446:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d196 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868726.534473:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079fd2105 reply state 00000000c129fb27 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.534485:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.534492:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93da88316500) 00010000:00010000:3.0:1787868726.534494:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868726.534497:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787868726.535046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+7:10517:x1874715918489984:12345-192.168.204.27@tcp:36:mkdir.0 Request processed in 3381us (3586us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787868726.535058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787868726.570533:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.571519:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918490112 00000100:00100000:2.0:1787868726.571533:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918490112 00000100:00100000:2.0:1787868726.571611:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1787868726.571620:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+7:10518:x1874715918490112:12345-192.168.204.27@tcp:101:chmod.0 00010000:00010000:2.0:1787868726.571641:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868726.571666:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d1ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef05 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571738:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571753:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571766:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868726.571815:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868726.571819:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868726.571859:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571885:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d1ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef05 expref: 9 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571906:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef05 expref: 8 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.571915:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:2.0:1787868726.571918:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868726.571922:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870200, rc 0) 00000100:00100000:2.0:1787868726.572000:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+8:10518:x1874715918490112:12345-192.168.204.27@tcp:101:chmod.0 Request processed in 380us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.572015:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1787868726.581748:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.582337:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918490368 00000100:00100000:3.0:1787868726.582351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918490368 00000100:00100000:3.0:1787868726.582423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1787868726.582434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+8:10518:x1874715918490368:12345-192.168.204.27@tcp:36:chmod.0 00010000:00010000:3.0:1787868726.582517:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868726.582550:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870200/0x2f11f4d3bde2d1b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef05 expref: 8 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.582571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:3.0:1787868726.582582:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868726.582612:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.582625:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.582635:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868726.582853:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014e424cf reply state 000000007144e715 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.582868:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.582874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:3.0:1787868726.582877:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787868726.582880:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787868726.582887:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787868726.582994:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+9:10518:x1874715918490368:12345-192.168.204.27@tcp:36:chmod.0 Request processed in 560us (1257us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787868726.583001:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1787868726.620977:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.621216:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918490496 00000100:00100000:2.0:1787868726.621229:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918490496 00000100:00100000:2.0:1787868726.621285:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1787868726.621308:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+9:10519:x1874715918490496:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:2.0:1787868726.621336:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868726.621361:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef0c expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621438:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621455:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621468:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868726.621515:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868726.621519:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868726.621559:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621597:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef0c expref: 11 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621616:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef0c expref: 10 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.621645:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:2.0:1787868726.621647:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868726.621650:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868726.621723:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+10:10519:x1874715918490496:12345-192.168.204.27@tcp:101:chown.0 Request processed in 418us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868726.621730:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1787868726.625819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.625994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918490624 00000100:00100000:3.0:1787868726.626006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918490624 00000100:00100000:3.0:1787868726.626149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1787868726.626204:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+10:10519:x1874715918490624:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:3.0:1787868726.626227:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868726.626247:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d1ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef13 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626331:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626347:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626361:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626371:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626378:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626385:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626462:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626471:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626478:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868726.626530:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787868726.626536:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868726.626559:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626572:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626579:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626605:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868726.626609:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626616:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:3.0:1787868726.626633:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868726.626637:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626643:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626657:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626673:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626679:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626684:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868726.626687:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626693:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626702:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93da88316500) 00010000:00010000:3.0:1787868726.626705:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868726.626708:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626714:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d1dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626745:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d1ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef13 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626758:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef13 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.626765:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:3.0:1787868726.626767:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868726.626777:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d200, rc 0) 00000100:00100000:3.0:1787868726.626843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+11:10519:x1874715918490624:12345-192.168.204.27@tcp:101:chown.0 Request processed in 634us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868726.626851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787868726.630947:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868726.631042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918490752 00000100:00100000:1.0:1787868726.631052:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918490752 00000100:00100000:1.0:1787868726.631176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1787868726.631188:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+11:10519:x1874715918490752:12345-192.168.204.27@tcp:900:chown.0 00000100:00100000:1.0:1787868726.631275:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+11:10519:x1874715918490752:12345-192.168.204.27@tcp:900:chown.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868726.631284:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1787868726.636660:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.637554:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491008 00000100:00100000:2.0:1787868726.637571:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491008 00000100:00100000:2.0:1787868726.637698:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1787868726.637711:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+11:10519:x1874715918491008:12345-192.168.204.27@tcp:36:chown.0 00010000:00010000:2.0:1787868726.637785:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868726.637820:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d1e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef13 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.637845:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:2.0:1787868726.637852:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868726.637885:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.637902:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.637915:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868726.645283:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787868726.645501:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff3a64b3 reply state 000000000082fade transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.645524:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.645534:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:2.0:1787868726.645537:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787868726.645551:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787868726.645564:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787868726.645676:0:10190:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787868726.645698:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+9:10519:x1874715918491008:12345-192.168.204.27@tcp:36:chown.0 Request processed in 7986us (9048us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787868726.645708:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00010000:00010000:0.0:1787868726.646601:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646615:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646623:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646629:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.646632:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646655:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646668:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:0.0:1787868726.646671:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787868726.646675:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.646681:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d1ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646931:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646940:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646946:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646952:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868726.646955:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646961:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646972:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93da88316500) 00010000:00010000:1.0:1787868726.646975:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868726.646978:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.646991:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d19d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647010:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647016:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647022:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647028:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828de00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868726.647031:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647037:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647045:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da88316f00) 00010000:00010000:1.0:1787868726.647048:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868726.647051:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647057:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d1a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647084:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647091:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647103:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647109:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868726.647113:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647120:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647128:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:1.0:1787868726.647131:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787868726.647134:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.647140:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d1b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868726.664283:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.664421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491136 00000100:00100000:0.0:1787868726.664432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491136 00000100:00100000:0.0:1787868726.664500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1787868726.664511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:10520:x1874715918491136:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1787868726.664542:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868726.664564:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d1f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868726.667038:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2243us 00010000:00010000:1.0:1787868726.686319:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686352:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686364:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686378:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686384:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686397:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686540:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686549:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868726.686588:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787868726.686591:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868726.686654:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686668:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686674:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686681:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686687:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868726.686691:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686698:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686717:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:1.0:1787868726.686720:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868726.686724:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686730:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d1f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686741:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686747:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686754:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686759:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868726.686762:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686768:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686775:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93dabeadf200) 00010000:00010000:1.0:1787868726.686777:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868726.686780:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686786:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d1ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686836:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d1f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef1a expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686850:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef1a expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868726.686857:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:1.0:1787868726.686859:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787868726.686861:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a600, rc 0) 00000100:00100000:1.0:1787868726.686935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+7:10520:x1874715918491136:12345-192.168.204.27@tcp:101:touch.500 Request processed in 22425us (22662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868726.686945:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1787868726.693305:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.693379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491392 00000100:00100000:0.0:1787868726.693390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491392 00000100:00100000:0.0:1787868726.693444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1787868726.693454:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+7:10520:x1874715918491392:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1787868726.693476:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868726.693508:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d20d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693659:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693675:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693686:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693702:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693709:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.693716:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868726.694759:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787868726.694916:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.694929:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.694939:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.694971:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.694991:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.694998:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695005:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.695010:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695018:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695031:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:0.0:1787868726.695035:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868726.695040:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695047:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d214 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868726.695075:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095058339 reply state 0000000053e623c8 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695088:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.695094:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbec1ed77 (ffff93da83a5f600) 00010000:00010000:0.0:1787868726.695097:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868726.695100:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787868726.695134:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d20d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef21 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.697940:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef21 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.697956:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868726.697959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868726.697963:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868726.698043:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+10:10520:x1874715918491392:12345-192.168.204.27@tcp:101:touch.500 Request processed in 4590us (4747us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787868726.698053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1787868726.704306:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.704761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491648 00000100:00100000:2.0:1787868726.704773:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491648 00000100:00100000:2.0:1787868726.706147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868726.706274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+10:10520:x1874715918491648:12345-192.168.204.27@tcp:36:touch.500 00010000:00010000:2.0:1787868726.706347:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868726.706378:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef21 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.706400:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868726.706411:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868726.706472:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.706506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.706516:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868726.707723:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b190a68 reply state 00000000ada40271 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.707745:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.707754:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:2.0:1787868726.707757:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868726.707760:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868726.707880:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+11:10520:x1874715918491648:12345-192.168.204.27@tcp:36:touch.500 Request processed in 1615us (3581us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787868726.707890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868726.710774:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.710868:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491776 00000100:00100000:0.0:1787868726.710876:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491776 00000100:00100000:0.0:1787868726.710960:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:0.0:1787868726.710970:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+11:10520:x1874715918491776:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1787868726.710993:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868726.711022:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d237 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef28 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.711090:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef28 expref: 12 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.711105:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef28 expref: 12 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.711122:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:0.0:1787868726.711126:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787868726.711142:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868726.711226:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+12:10520:x1874715918491776:12345-192.168.204.27@tcp:101:touch.500 Request processed in 256us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868726.711233:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:2.0:1787868726.714308:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.714400:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918491904 00000100:00100000:3.0:1787868726.714412:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918491904 00000100:00100000:3.0:1787868726.714490:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787868726.714499:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918491904:12345-192.168.204.27@tcp:8:touch.500 00010000:00080000:3.0:1787868726.714536:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:3.0:1787868726.714572:0:8430:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d23e 00002000:00100000:3.0:1787868726.714596:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 666039a7-1461-4e99-8c4e-10237114565a/ffff93dab7f77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787868726.714608:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787868726.714694:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787868726.714724:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868726.714799:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918491904:12345-192.168.204.27@tcp:8:touch.500 Request processed in 299us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868726.714807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1787868726.718902:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.719561:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918492032 00000100:00100000:3.0:1787868726.719569:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918492032 00000100:00100000:3.0:1787868726.719733:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1787868726.719744:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918492032:12345-192.168.204.27@tcp:2:touch.500 00000100:00080000:1.0:1787868726.720419:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787868726.746449:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1787868726.746467:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000100:00100000:3.0:1787868726.746804:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+5:0:x1874715918492032:12345-192.168.204.27@tcp:2:touch.500 Request processed in 27055us (27910us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787868726.746833:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1787868726.751220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.751309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918492288 00000100:00100000:3.0:1787868726.751320:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918492288 00000100:00100000:3.0:1787868726.751379:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1787868726.751390:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+12:10520:x1874715918492288:12345-192.168.204.27@tcp:35:touch.500 00000100:00100000:3.0:1787868726.753456:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+13:10520:x1874715918492288:12345-192.168.204.27@tcp:35:touch.500 Request processed in 2058us (2237us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787868726.753468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1787868726.776097:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868726.776439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918492416 00000100:00100000:1.0:1787868726.776450:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918492416 00000100:00100000:0.0:1787868726.776715:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1787868726.776727:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+13:10521:x1874715918492416:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:0.0:1787868726.776756:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868726.776777:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.776852:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.776866:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.776878:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868726.776919:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868726.776924:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868726.777250:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.777280:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef2f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.777316:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef2f expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.777327:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:0.0:1787868726.777330:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868726.777333:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286800, rc 0) 00000100:00100000:0.0:1787868726.777402:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+14:10521:x1874715918492416:12345-192.168.204.27@tcp:101:rm.0 Request processed in 677us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868726.777409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1787868726.783883:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.783968:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918492672 00000100:00100000:3.0:1787868726.783979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918492672 00000100:00100000:3.0:1787868726.784044:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1787868726.784055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+14:10521:x1874715918492672:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:3.0:1787868726.784093:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868726.784118:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef36 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868726.784559:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787868726.784803:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d253 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef36 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.784819:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:2.0:1787868726.784823:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868726.784828:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef36 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.784861:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c400, rc 0) 00000100:00100000:2.0:1787868726.784985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+15:10521:x1874715918492672:12345-192.168.204.27@tcp:101:rm.0 Request processed in 932us (1111us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787868726.784995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1787868726.790390:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.790547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918492800 00000100:00100000:0.0:1787868726.790558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918492800 00000100:00100000:0.0:1787868726.790720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1787868726.790732:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+15:10521:x1874715918492800:12345-192.168.204.27@tcp:37:rm.0 00000100:00100000:0.0:1787868726.797299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+15:10521:x1874715918492800:12345-192.168.204.27@tcp:37:rm.0 Request processed in 6558us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868726.797314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868726.802938:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.803106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918493056 00000100:00100000:3.0:1787868726.803117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918493056 00000100:00100000:3.0:1787868726.803351:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1787868726.803362:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+15:10521:x1874715918493056:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:3.0:1787868726.803608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+16:10521:x1874715918493056:12345-192.168.204.27@tcp:35:rm.0 Request processed in 247us (680us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787868726.803615:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1787868726.812433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868726.812522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918493312 00000100:00100000:3.0:1787868726.812533:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918493312 00000100:00100000:3.0:1787868726.812626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:3.0:1787868726.812638:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+16:10521:x1874715918493312:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:3.0:1787868726.812668:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868726.812690:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef3d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.812832:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d268 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.812848:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.812861:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868726.812872:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868726.812989:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef3d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.813551:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef3d expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.813561:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:3.0:1787868726.813564:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787868726.813568:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d800, rc 0) 00000100:00100000:3.0:1787868726.813695:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918493312:12345-192.168.204.27@tcp:101:rm.0 Request processed in 1059us (1274us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787868726.813704:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1787868726.818524:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.818682:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918493440 00000100:00100000:0.0:1787868726.818693:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918493440 00000100:00100000:0.0:1787868726.818785:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787868726.818796:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918493440:12345-192.168.204.27@tcp:41:rm.0 00000004:00000024:0.0:1787868726.818850:0:10190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787868726.818931:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918493440:12345-192.168.204.27@tcp:41:rm.0 Request processed in 136us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868726.818939:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:2.0:1787868726.822608:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.822698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918493568 00000100:00100000:0.0:1787868726.822709:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918493568 00000100:00100000:0.0:1787868726.822778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:0.0:1787868726.822788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918493568:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:0.0:1787868726.822813:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868726.822837:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d276 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822913:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822929:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822942:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822953:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822959:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.822965:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823054:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823075:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823102:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868726.823142:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787868726.823147:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868726.823209:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823232:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823239:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823245:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823251:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.823256:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823265:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823278:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:0.0:1787868726.823281:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868726.823285:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823303:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d27d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823317:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823322:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823328:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823333:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.823335:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823341:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823348:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbec1ed77 (ffff93da83a5f600) 00010000:00010000:0.0:1787868726.823350:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868726.823353:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823359:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d284 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823388:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d276 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef44 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823401:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef44 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.823414:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:0.0:1787868726.823417:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868726.823419:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:0.0:1787868726.823493:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+19:10521:x1874715918493568:12345-192.168.204.27@tcp:101:rm.0 Request processed in 707us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868726.823502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1787868726.828331:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868726.828558:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918493824 00000100:00100000:2.0:1787868726.828568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918493824 00000100:00100000:2.0:1787868726.828635:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1787868726.828645:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+19:10521:x1874715918493824:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:2.0:1787868726.828706:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787868726.828736:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d28b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef44 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828758:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d237 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef28 expref: 18 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828768:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:2.0:1787868726.828777:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2d24c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef2f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828787:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:2.0:1787868726.828790:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868726.828819:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828832:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828841:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828850:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828856:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828862:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828950:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828958:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.828964:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787868726.829245:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787868726.829255:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350955098738ns, next at 351955096280ns, rc = 0 00010000:00010000:2.0:1787868726.829302:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829311:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829325:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829333:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829340:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829347:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829369:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868726.829387:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829394:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829401:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829407:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868726.829411:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829419:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829428:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:2.0:1787868726.829431:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787868726.829443:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829449:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d2a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829465:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829471:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829476:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829482:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868726.829484:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829489:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829497:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:2.0:1787868726.829500:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868726.829502:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829507:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d292 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868726.829516:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7948a6 reply state 00000000708e7d28 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829537:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868726.829543:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbec1ed77 (ffff93da83a5f600) 00010000:00010000:2.0:1787868726.829546:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868726.829549:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868726.829621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918493824:12345-192.168.204.27@tcp:36:rm.0 Request processed in 975us (1298us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787868726.829628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00010000:00010000:3.0:1787868726.829942:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868726.829949:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.829956:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868726.829958:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.829964:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.829974:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:3.0:1787868726.829976:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787868726.829979:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.829985:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d2a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868726.829995:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868726.829997:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868726.829999:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868726.836439:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.836678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494080 00000100:00100000:0.0:1787868726.836689:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494080 00000100:00100000:0.0:1787868726.836754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868726.836765:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918494080:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:0.0:1787868726.837015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+19:10521:x1874715918494080:12345-192.168.204.27@tcp:35:rm.0 Request processed in 252us (586us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787868726.837024:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1787868726.841713:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868726.841889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494336 00000100:00100000:0.0:1787868726.841900:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494336 00000100:00100000:0.0:1787868726.841977:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1787868726.841988:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+19:10521:x1874715918494336:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:0.0:1787868726.842077:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787868726.842107:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef3d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842134:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef1a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842145:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93dabeadfa00) 00010000:00010000:0.0:1787868726.842234:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d1c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef0c expref: 17 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842244:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316b00) 00010000:00010000:0.0:1787868726.842251:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868726.842275:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842287:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842296:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842306:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842312:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842317:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842401:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842409:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842416:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868726.842678:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787868726.842700:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842707:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842714:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842720:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.842724:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842731:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842741:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93da83a5f700) 00010000:00010000:0.0:1787868726.842744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787868726.842747:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2d2bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842771:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842777:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842784:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842788:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868726.842797:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842803:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842811:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da83a5ff00) 00010000:00010000:0.0:1787868726.842813:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868726.842816:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287c00/0x2f11f4d3bde2d2ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868726.842831:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000234c95ae reply state 000000003b642adb transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842841:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868726.842847:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93da83a5fc00) 00010000:00010000:0.0:1787868726.842849:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868726.842852:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868726.842928:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:10521:x1874715918494336:12345-192.168.204.27@tcp:36:rm.0 Request processed in 942us (1226us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787868726.842936:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00010000:00010000:2.0:1787868727.396178:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868728.428979:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868729.448762:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868730.465407:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868730.657552:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868730.657587:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939553280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868730.657663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.658217:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939553408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868730.658254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.658836:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939553536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868730.658875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.659024:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553280 00000100:00100000:2.0:1787868730.659032:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553280 00000100:00100000:2.0:1787868730.659097:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553408 00000100:00100000:2.0:1787868730.659101:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553408 00000100:00100000:2.0:1787868730.659121:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787868730.659130:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939553280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868730.659182:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868730.659245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939553280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868730.659251:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787868730.659268:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787868730.659275:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939553408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868730.659284:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868730.659307:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939553408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868730.659342:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1787868730.659748:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c51e00 x1874715939553408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868730.659772:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939553408:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787868730.659789:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882b9a40 x1874715939553280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868730.659801:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939553280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868730.659894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553536 00000100:00100000:0.0:1787868730.659901:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553536 00000100:00100000:0.0:1787868730.659948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787868730.659957:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939553536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868730.659981:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868730.660041:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939553536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868730.660047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787868730.660334:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868730.660365:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939553536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868730.674816:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939553920:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.674907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.674967:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939554432:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.674998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.675028:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868730.675033:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939553792:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.675053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.675068:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939554304:0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.675224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553920 00000100:00100000:3.0:1787868730.675234:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553920 00000100:00100000:3.0:1787868730.675280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554432 00000100:00100000:3.0:1787868730.675284:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554432 00000100:00100000:3.0:1787868730.675306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553792 00000100:00100000:3.0:1787868730.675308:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553792 00000100:00100000:3.0:1787868730.675322:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787868730.675331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939553920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.675406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939553920:12345-0@lo:400:kworker.0 Request processed in 75us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868730.675414:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787868730.675430:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787868730.675437:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.675463:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939554432:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868730.675468:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787868730.675479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787868730.675485:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939553792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.675509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939553792:12345-0@lo:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868730.675514:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:3.0:1787868730.675533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868730.675996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868730.676027:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939554816:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.676056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676215:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939554048:0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939554560:0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676307:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868730.676314:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939553664:0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676363:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939554176:0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676408:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939554688:0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868730.676545:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554816 00000100:00100000:2.0:1787868730.676551:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554816 00000100:00100000:2.0:1787868730.676605:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554688 00000100:00100000:2.0:1787868730.676608:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554688 00000100:00100000:2.0:1787868730.676625:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787868730.676632:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676678:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939554816:12345-0@lo:400:kworker.0 Request processed in 48us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868730.676685:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787868730.676697:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787868730.676702:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939554688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868730.676728:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939554688:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868730.676733:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1787868730.676766:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882dd680 x1874715939554688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868730.676780:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939554688:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.677287:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939553920:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.677304:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939554432:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.677336:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939553792:0@lo:400:kworker.0 00010000:00080000:1.0:1787868730.677347:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f1d680 x1874715939554816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868730.677356:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939554816:0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.677755:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554304 00000100:00100000:0.0:1787868730.677761:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554304 00000100:00100000:0.0:1787868730.677793:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554560 00000100:00100000:0.0:1787868730.677796:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554560 00000100:00100000:0.0:1787868730.677810:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554176 00000100:00100000:0.0:1787868730.677812:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554176 00000100:00100000:0.0:1787868730.677830:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787868730.677838:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939554304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.677920:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939554304:12345-0@lo:400:kworker.0 Request processed in 83us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868730.677927:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787868730.677944:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787868730.677950:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939554560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.677996:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939554560:12345-0@lo:400:kworker.0 Request processed in 34us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868730.678002:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787868730.678013:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787868730.678018:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939554176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.678047:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939554176:12345-0@lo:400:kworker.0 Request processed in 29us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868730.678052:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787868730.678102:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939553664 00000100:00100000:0.0:1787868730.678106:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939553664 00000100:00100000:0.0:1787868730.678134:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787868730.678141:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939553664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.678212:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939553664:12345-0@lo:400:kworker.0 Request processed in 72us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868730.678218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787868730.678270:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939553664:0@lo:400:kworker.0 00000100:00100000:0.0:1787868730.678282:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939554176:0@lo:400:kworker.0 00010000:00080000:0.0:1787868730.678293:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882de580 x1874715939554560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868730.678302:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939554560:0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.679823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554048 00000100:00100000:3.0:1787868730.679836:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554048 00000100:00100000:3.0:1787868730.679898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787868730.679908:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939554048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868730.680017:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939554048:12345-0@lo:400:kworker.0 Request processed in 111us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868730.680024:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1787868730.680063:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868730.680068:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868730.680071:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787868730.680351:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882dfc00 x1874715939554304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868730.680365:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939554304:0@lo:400:kworker.0 00000100:00100000:1.0:1787868730.681135:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939554048:0@lo:400:kworker.0 00000100:00100000:3.0:1787868731.169570:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868731.169600:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939554944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868731.169690:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868731.169779:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939554944 00000100:00100000:3.0:1787868731.169786:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939554944 00000100:00100000:3.0:1787868731.169833:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787868731.169842:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939554944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868731.169874:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868731.169918:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939554944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868731.169925:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787868731.169966:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939554944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868731.170096:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868731.170107:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939555072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868731.170138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868731.170191:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555072 00000100:00100000:2.0:1787868731.170194:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555072 00000100:00100000:2.0:1787868731.170229:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787868731.170236:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939555072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868731.170256:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868731.170288:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939555072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868731.170305:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1787868731.170335:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f943c0 x1874715939555072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868731.170349:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939555072:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1787868731.170785:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355296627034ns, next at 356296624287ns, rc = 0 00000100:00100000:3.0:1787868731.170848:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868731.170859:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939555200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868731.170893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868731.186906:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555200 00000100:00100000:0.0:1787868731.186920:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555200 00000100:00100000:0.0:1787868731.186996:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787868731.187008:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939555200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868731.187036:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868731.187131:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939555200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (16228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.187138:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1787868731.187307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabd8530c0 x1874715939555200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868731.187329:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939555200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787868731.491516:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868731.610405:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610527:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610543:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610563:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610589:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868731.610614:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494848 00000100:00100000:2.0:1787868731.610624:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494848 00000100:00100000:2.0:1787868731.610693:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1787868731.610704:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918494848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868731.610795:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918494848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868731.610802:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:0.0:1787868731.610876:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494464 00000100:00100000:0.0:1787868731.610881:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494464 00000100:00100000:0.0:1787868731.610935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 342 00000100:00100000:0.0:1787868731.610944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918494464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868731.611019:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918494464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.611027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 342 00000100:00100000:0.0:1787868731.611058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494720 00000100:00100000:0.0:1787868731.611062:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494720 00000100:00100000:0.0:1787868731.611082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494976 00000100:00100000:0.0:1787868731.611084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494976 00000100:00100000:0.0:1787868731.611097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918494592 00000100:00100000:0.0:1787868731.611100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918494592 00000100:00100000:0.0:1787868731.611110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495104 00000100:00100000:0.0:1787868731.611112:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495104 00000100:00100000:0.0:1787868731.611125:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:0.0:1787868731.611131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918494720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868731.611181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918494720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.611187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:0.0:1787868731.611197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:0.0:1787868731.611203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918494976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868731.611223:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918494976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.611228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:0.0:1787868731.611236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1787868731.611241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:2403:x1874715918494592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868731.611262:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:2403:x1874715918494592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.611282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1787868731.611295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:0.0:1787868731.611301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918495104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868731.611325:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2403:x1874715918495104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868731.611330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00080000:3.0:1787868731.612266:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868731.612273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868731.612275:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1787868731.717211:0:13680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787868732.513469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787868732.721298:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787868732.721353:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1787868732.721363:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787868732.721559:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939555328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787868732.721629:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868732.721726:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555328 00000100:00100000:2.0:1787868732.721733:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555328 00000100:00100000:2.0:1787868732.721788:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868732.721797:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939555328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787868732.721823:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1787868732.721868:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a90b636, atime: 0x6a90b636, ctime: 0x6a90b636, blocks: 0x0 00010000:00010000:2.0:1787868732.721876:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.721894:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1787868732.721899:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868732.721906:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.721923:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.721933:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.721941:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.721969:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787868732.722396:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939555328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 599us (765us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787868732.722404:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787868732.722426:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787868732.722439:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868732.722456:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.722465:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868732.722476:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.722487:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.722513:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.722521:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2d2c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868732.722538:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868732.722540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868732.722542:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787868732.722574:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9882d9e00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787868732.722580:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939555328:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787868732.722776:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722784:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722790:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722795:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868732.722800:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722806:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722817:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbec1ed77 (ffff93da83a5f600) 00010000:00010000:0.0:1787868732.722820:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868732.722823:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722829:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d21b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722851:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722857:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722863:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722867:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868732.722870:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722876:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722884:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93dab5b3fc00) 00010000:00010000:0.0:1787868732.722886:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868732.722889:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722895:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d230 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722909:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722916:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722922:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722933:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868732.722936:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722942:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722962:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbec1ed77 (ffff93da83a5f600) 00010000:00010000:0.0:1787868732.722964:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868732.722967:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722972:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870e00/0x2f11f4d3bde2d299 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbec1ed77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722988:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722993:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.722998:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.723003:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868732.723006:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.723012:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.723030:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93da83a5fc00) 00010000:00010000:0.0:1787868732.723032:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868732.723035:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868732.723040:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d2b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787868733.310859:0:13728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe173eb6e0 20000000:00000080:0.0:1787868733.310876:0:13728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d988346400 uarg=0000000000000000 20000000:01000000:0.0:1787868733.313613:0:13728:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787868733.313624:0:13728:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787868733.313630:0:13728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787868733.316307:0:13729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787868733.316464:0:13728:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787868733.328886:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787868733.328955:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787868733.328975:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787868733.328995:0:13728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787868733.329016:0:13728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329772:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329782:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329788:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329795:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329804:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329810:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329817:0:13728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329856:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.329870:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 12 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.329900:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555456:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868733.330338:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.330348:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.330357:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555584:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868733.330405:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.330413:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 23 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.330422:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f1d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555712:0@lo:104: 00000100:00100000:1.0:1787868733.330462:0:13728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868733.330507:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.330514:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 23 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.330522:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555840:0@lo:104: 00010000:00010000:1.0:1787868733.330546:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.330554:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.330571:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555968:0@lo:104: 00010000:00010000:1.0:1787868733.330597:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868733.330605:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 23 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.330613:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939556096:0@lo:104: 00000100:00100000:1.0:1787868733.330631:0:13728:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da89f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868733.330837:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787868733.330858:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868733.330881:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868733.330890:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868733.330899:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555712 00000100:00100000:0.0:1787868733.330906:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555712 00000100:00100000:0.0:1787868733.330957:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555840 00000100:00100000:0.0:1787868733.330961:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555840 00000100:00100000:0.0:1787868733.330972:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939555968 00000100:00100000:0.0:1787868733.330974:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939555968 00000100:00100000:0.0:1787868733.331001:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556096 00000100:00100000:0.0:1787868733.331005:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556096 00000100:00100000:0.0:1787868733.331019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868733.331027:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:13728:x1874715939555712:12345-0@lo:104: 00010000:00010000:0.0:1787868733.331041:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868733.331112:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868733.331118:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+6:13728:x1874715939555712:12345-0@lo:104: Request processed in 93us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868733.331125:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868733.331187:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868733.331193:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:13728:x1874715939555840:12345-0@lo:104: 00010000:00010000:0.0:1787868733.331200:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868733.331231:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787868733.331236:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+5:13728:x1874715939555840:12345-0@lo:104: Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868733.331241:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868733.331254:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868733.331260:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:13728:x1874715939555968:12345-0@lo:104: 00010000:00010000:0.0:1787868733.331267:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868733.331299:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787868733.331304:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+4:13728:x1874715939555968:12345-0@lo:104: Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868733.331311:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868733.331322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868733.331327:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13728:x1874715939556096:12345-0@lo:104: 00010000:00010000:0.0:1787868733.331335:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331473:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787868733.331480:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331487:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868733.331491:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331507:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868733.331514:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868733.331520:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868733.331552:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331559:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868733.331581:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331589:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2d17a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d181 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331602:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868733.331605:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331611:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828da00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868733.331614:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331621:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868733.331627:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868733.331637:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868733.331652:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331658:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868733.331675:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331682:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828da00/0x2f11f4d3bde2d16c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d173 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331691:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868733.331693:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331698:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868733.331701:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331709:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868733.331715:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868733.331720:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868733.331733:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331738:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868733.331765:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331773:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2d15e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d165 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.331782:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868733.331784:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868733.331785:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868733.331792:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868733.331803:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939556224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.332334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868733.332391:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939556352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.332414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868733.332431:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868733.332436:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939556480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.332451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868733.332474:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556224 00000100:00100000:3.0:1787868733.332478:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556224 00010000:00010000:3.0:1787868733.332503:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 24 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.332524:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556352 00000100:00100000:3.0:1787868733.332526:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556352 00010000:00010000:3.0:1787868733.332535:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.332543:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556480 00000100:00100000:3.0:1787868733.332545:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556480 00010000:00010000:3.0:1787868733.332552:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 26 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.332571:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787868733.332578:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+26:3637:x1874715939556224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.332590:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.332595:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 26 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332605:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 26 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332623:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.332651:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+26:3637:x1874715939556224:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.332657:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787868733.332672:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868733.332678:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3638:x1874715939556352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.332685:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.332690:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332698:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332706:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.332732:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+25:3638:x1874715939556352:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.332738:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868733.332767:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868733.332780:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939556480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.332788:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.332793:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 24 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332801:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 24 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.332810:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.332833:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939556480:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.332838:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868733.332880:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939556480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.332888:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939556352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.332913:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939556224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.332961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868733.333551:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868733.333559:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+3:13728:x1874715939556096:12345-0@lo:104: Request processed in 2231us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868733.333566:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787868733.333630:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868733.333638:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333646:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868733.333649:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333658:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868733.333664:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868733.333678:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787868733.333717:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333723:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868733.333740:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333746:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2d150 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2d157 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333760:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868733.333762:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868733.333764:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868733.333775:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939556608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868733.333811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868733.333850:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556608 00000100:00100000:3.0:1787868733.333854:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556608 00010000:00010000:3.0:1787868733.333871:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 24 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.333890:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868733.333896:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939556608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.333905:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.333909:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 24 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333918:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 24 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.333948:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.333978:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939556608:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.333984:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868733.334015:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939556608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868733.334738:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2d181 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d17a expref: 23 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.334750:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f1d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555712:0@lo:104: 00010000:00010000:1.0:1787868733.334762:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2d173 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d16c expref: 22 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.334770:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555840:0@lo:104: 00010000:00010000:1.0:1787868733.334781:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2d165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d15e expref: 21 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.334788:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c521c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555968:0@lo:104: 00010000:00010000:1.0:1787868733.334796:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286200/0x2f11f4d3bde2d157 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2d150 expref: 20 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868733.334803:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939556096:0@lo:104: 00000100:00100000:0.0:1787868733.342204:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555456:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868733.342224:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874715939555584:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868733.342263:0:13728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868733.350846:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868733.350982:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868733.351093:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495232 00000100:00100000:3.0:1787868733.351103:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495232 00010000:00010000:3.0:1787868733.351228:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 13 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.351260:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495360 00000100:00100000:3.0:1787868733.351263:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495360 00010000:00010000:3.0:1787868733.351276:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 14 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868733.351306:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787868733.351316:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+14:2403:x1874715918495232:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.351332:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.351338:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 14 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351351:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 14 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351383:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b000/0x2f11f4d3bde2d18f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feefe expref: 14 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351400:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.351464:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918495232:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 148us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.351473:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787868733.351491:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1787868733.351499:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:2403:x1874715918495360:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868733.351507:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868733.351512:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351521:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351531:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2d188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feef7 expref: 12 pid: 6505 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351542:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351550:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351566:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351584:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351591:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351597:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351610:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868733.351614:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351622:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351635:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.351646:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868733.351667:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2403:x1874715918495360:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 170us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868733.351674:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00010000:00010000:0.0:1787868733.352114:0:13728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868733.352123:0:13728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868733.352129:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2d2ca lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868733.543435:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787868734.433661:0:13777:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5cd75900 20000000:00000080:3.0:1787868734.433678:0:13777:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d988233000 uarg=0000000000000000 20000000:01000000:3.0:1787868734.433721:0:13777:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787868734.433728:0:13777:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787868734.433733:0:13777:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1787868734.434670:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787868734.434883:0:13777:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787868734.434978:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787868734.435128:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787868734.435149:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787868734.435196:0:13777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787868734.435217:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435233:0:13777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435252:0:13777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435260:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435268:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435276:0:13777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435283:0:13777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868734.435288:0:13777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435297:0:13777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435310:0:13777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435318:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.435325:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828cc00/0x2f11f4d3bde2d2d1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868734.564620:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868734.936968:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868734.937196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495488 00000100:00100000:0.0:1787868734.937206:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495488 00000100:00100000:0.0:1787868734.937266:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 343 00000100:00100000:0.0:1787868734.937276:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:6180:x1874715918495488:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868734.937303:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868734.937327:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2d2d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef4b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868734.937373:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2d2d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef4b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868734.937383:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2d2d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef4b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868734.937394:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286600, rc 0) 00000100:00100000:0.0:1787868734.937463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918495488:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 188us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868734.937470:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 343 00000100:00100000:3.0:1787868734.950079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868734.951143:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495616 00000100:00100000:2.0:1787868734.951172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495616 00000100:00100000:2.0:1787868734.951240:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:2.0:1787868734.951252:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918495616:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868734.953771:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918495616:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 2510us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868734.953785:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:1.0:1787868734.967716:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868734.973599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495744 00000100:00100000:2.0:1787868734.973633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495744 00000100:00100000:2.0:1787868734.973713:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:2.0:1787868734.973724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918495744:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868734.974283:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918495744:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 558us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868734.974292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:3.0:1787868734.989813:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868734.989927:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918495872 00000100:00100000:0.0:1787868734.989948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918495872 00000100:00100000:0.0:1787868734.990036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:0.0:1787868734.990046:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:10806:x1874715918495872:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868734.990241:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:10806:x1874715918495872:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 195us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868734.990252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:3.0:1787868735.005675:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868735.006127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496000 00000100:00100000:0.0:1787868735.006140:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496000 00000100:00100000:0.0:1787868735.006239:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:0.0:1787868735.006250:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:10806:x1874715918496000:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868735.006627:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:10806:x1874715918496000:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 378us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.006634:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:1.0:1787868735.014828:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868735.014973:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496128 00000100:00100000:3.0:1787868735.014985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496128 00000100:00100000:3.0:1787868735.015054:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00100000:3.0:1787868735.015065:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:6180:x1874715918496128:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868735.015083:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868735.015103:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2d2df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef52 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868735.015131:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef52 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868735.015142:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef52 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868735.015152:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828da00, rc 0) 00000100:00100000:3.0:1787868735.015250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918496128:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 187us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868735.015257:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00100000:3.0:1787868735.035129:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868735.035417:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496256 00000100:00100000:0.0:1787868735.035455:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496256 00000100:00100000:0.0:1787868735.035551:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 349 00000100:00100000:0.0:1787868735.035565:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918496256:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.035751:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918496256:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 188us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.035761:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 349 00000100:00100000:0.0:1787868735.039850:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868735.048988:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496384 00000100:00100000:2.0:1787868735.049005:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496384 00000100:00100000:2.0:1787868735.049090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 350 00000100:00100000:2.0:1787868735.049103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918496384:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868735.049306:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:6180:x1874715918496384:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 205us (9465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.049315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 350 00000100:00100000:1.0:1787868735.075050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868735.075235:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496512 00000100:00100000:3.0:1787868735.075254:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496512 00000100:00100000:3.0:1787868735.075339:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 351 00000100:00100000:3.0:1787868735.075352:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:10809:x1874715918496512:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787868735.075600:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:10809:x1874715918496512:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 250us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868735.075621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 351 00000100:00100000:3.0:1787868735.083215:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868735.083353:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496640 00000100:00100000:0.0:1787868735.083369:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496640 00000100:00100000:0.0:1787868735.083451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 352 00000100:00100000:0.0:1787868735.083464:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:10809:x1874715918496640:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868735.084444:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:10809:x1874715918496640:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 976us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.084458:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 352 10000000:01000000:0.0:1787868735.329374:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868735.329386:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dabec41000 from 7 10000000:01000000:0.0:1787868735.329392:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868735.329466:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.329482:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.329496:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868735.329539:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.329647:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868735.329773:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868735.330236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556736 00000100:00100000:2.0:1787868735.330248:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556736 00000100:00100000:2.0:1787868735.330324:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787868735.330338:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:6510:x1874715939556736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868735.330371:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868735.330394:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2d2ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d2e6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.330429:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2e6 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.330443:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2e6 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.330472:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870200, rc 0) 00000100:00100000:2.0:1787868735.330614:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939556736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.330621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787868735.333216:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868735.333260:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868735.333275:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868735.333423:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.333521:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.333594:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787868735.334072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556864 00000100:00100000:2.0:1787868735.334082:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556864 00000100:00100000:2.0:1787868735.334183:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787868735.334197:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939556864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868735.334391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939556864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.334400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787868735.338498:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.338625:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.338745:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.338826:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.339501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939556992 00000100:00100000:0.0:1787868735.339515:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939556992 00000100:00100000:0.0:1787868735.339609:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787868735.339622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939556992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.339832:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939556992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.339842:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787868735.340197:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.342272:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13790:1874715939557120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868735.342394:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.342459:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868735.342610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557120 00000100:00100000:2.0:1787868735.342619:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557120 00000100:00100000:2.0:1787868735.342698:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787868735.342712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:13790:x1874715939557120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868735.342906:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:13790:x1874715939557120:12345-0@lo:502:llog_process_th.0 Request processed in 182us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.342917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787868735.344560:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13790:1874715939557120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868735.344617:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868735.344633:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.344646:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868735.344656:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dabec41000 00000020:00000080:3.0:1787868735.344659:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868735.344743:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868735.344747:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.344748:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868735.344751:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868735.344753:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.344755:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787868735.344758:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dabec41000 00000020:00000080:3.0:1787868735.344760:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787868735.345401:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13790:1874715939557248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868735.345564:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.345698:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.345767:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557248 00000100:00100000:0.0:1787868735.346181:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557248 00000100:00100000:0.0:1787868735.346298:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787868735.346310:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:13790:x1874715939557248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868735.346545:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:13790:x1874715939557248:12345-0@lo:502:llog_process_th.0 Request processed in 170us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.346556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787868735.346645:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13790:1874715939557248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868735.346682:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868735.346691:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.346693:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787868735.346701:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787868735.346980:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787868735.347012:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787868735.347029:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347043:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868735.347058:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787868735.347061:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab5b24800 from 7 10000000:01000000:1.0:1787868735.347065:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868735.347115:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347125:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347137:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868735.347217:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.347276:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.347316:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da89f316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.347337:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557376 00000100:00100000:1.0:1787868735.347344:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557376 00000100:00100000:1.0:1787868735.347391:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787868735.347401:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:6510:x1874715939557376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868735.347415:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868735.347446:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2d2fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d2f4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347473:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2f4 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347485:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2f4 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347497:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b200, rc 0) 00000100:00100000:1.0:1787868735.347536:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939557376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.347544:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787868735.347585:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868735.347601:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.347612:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868735.347677:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.347713:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.347739:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da89f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.350351:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557504 00000100:00100000:0.0:1787868735.350376:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557504 00000100:00100000:0.0:1787868735.350468:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787868735.350481:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939557504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.350725:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939557504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.350734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787868735.351082:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.351182:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.351755:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.351798:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da89f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.352111:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557632 00000100:00100000:0.0:1787868735.352118:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557632 00000100:00100000:0.0:1787868735.352202:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787868735.352211:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939557632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.352368:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939557632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.352386:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787868735.352687:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.353805:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13791:1874715939557760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868735.353910:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868735.353965:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.354025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557760 00000100:00100000:1.0:1787868735.354032:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557760 00000100:00100000:1.0:1787868735.354086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787868735.354098:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:13791:x1874715939557760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868735.354264:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:13791:x1874715939557760:12345-0@lo:502:llog_process_th.0 Request processed in 167us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.354271:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787868735.354443:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13791:1874715939557760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868735.354475:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868735.354488:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868735.354491:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787868735.354501:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab5b24800 00000020:00000080:0.0:1787868735.354504:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787868735.354574:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868735.354578:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868735.354579:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787868735.354582:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868735.354585:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868735.354586:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787868735.354590:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab5b24800 00000020:00000080:0.0:1787868735.354592:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787868735.354629:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13791:1874715939557888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868735.354673:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868735.354707:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.354767:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939557888 00000100:00100000:1.0:1787868735.354772:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939557888 00000100:00100000:1.0:1787868735.354806:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787868735.354815:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:13791:x1874715939557888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868735.354910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:13791:x1874715939557888:12345-0@lo:502:llog_process_th.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.354917:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787868735.355044:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13791:1874715939557888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787868735.355063:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868735.355068:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868735.355070:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787868735.355075:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787868735.356595:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787868735.356656:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787868735.356670:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.356684:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868735.356697:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787868735.356700:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daaf704800 from 7 10000000:01000000:1.0:1787868735.356703:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868735.356746:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.356755:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.356777:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868735.356805:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.356887:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.356956:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91624480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868735.357148:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558016 00000100:00100000:2.0:1787868735.357283:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558016 00000100:00100000:2.0:1787868735.357331:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787868735.357341:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:6510:x1874715939558016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868735.357356:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868735.357371:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d302 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.357415:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d302 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.357429:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d302 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868735.357439:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870e00, rc 0) 00000100:00100000:2.0:1787868735.357541:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.357548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787868735.357725:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868735.357758:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.357767:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868735.359971:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.360209:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868735.360273:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.360337:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558144 00000100:00100000:1.0:1787868735.360347:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558144 00000100:00100000:1.0:1787868735.360421:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787868735.360435:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.360645:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.360655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787868735.360803:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.360857:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.360935:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868735.360957:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.361065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558272 00000100:00100000:1.0:1787868735.361070:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558272 00000100:00100000:1.0:1787868735.361103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787868735.361110:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.361271:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.361278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787868735.364575:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.365417:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13794:1874715939558400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868735.365725:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.365804:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.365867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558400 00000100:00100000:0.0:1787868735.365876:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558400 00000100:00100000:0.0:1787868735.366019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787868735.366031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:13794:x1874715939558400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868735.366239:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:13794:x1874715939558400:12345-0@lo:502:llog_process_th.0 Request processed in 209us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.366247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787868735.366427:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13794:1874715939558400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868735.366487:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868735.366499:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.366501:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868735.366511:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daaf704800 00000020:00000080:3.0:1787868735.366514:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868735.366589:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868735.366593:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.366595:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868735.366608:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868735.366611:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.366612:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787868735.366616:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daaf704800 00000020:00000080:3.0:1787868735.366618:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787868735.366674:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13794:1874715939558528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868735.366750:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.366793:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787868735.366819:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558528 00000100:00100000:1.0:1787868735.366827:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558528 00000100:00100000:1.0:1787868735.366878:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787868735.366887:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:13794:x1874715939558528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868735.367032:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:13794:x1874715939558528:12345-0@lo:502:llog_process_th.0 Request processed in 146us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.367040:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787868735.368191:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13794:1874715939558528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868735.368421:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868735.368432:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868735.368434:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787868735.368440:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787868735.368609:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787868735.368659:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787868735.368675:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.368689:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868735.368702:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787868735.368705:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05d8800 from 7 10000000:01000000:1.0:1787868735.368709:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868735.368754:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.368763:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868735.368775:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868735.368803:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868735.368878:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.368942:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.369116:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558656 00000100:00100000:0.0:1787868735.369125:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558656 00000100:00100000:0.0:1787868735.369217:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787868735.369240:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:6510:x1874715939558656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868735.369256:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868735.369272:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286800/0x2f11f4d3bde2d317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2d310 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.369304:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286800/0x2f11f4d3bde2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d310 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.369608:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286800/0x2f11f4d3bde2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2d310 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.369621:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286800, rc 0) 00000100:00100000:0.0:1787868735.369696:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939558656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 458us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.369704:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787868735.370043:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868735.370065:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868735.370075:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868735.370335:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.370386:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.370420:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.370645:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558784 00000100:00100000:0.0:1787868735.370652:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558784 00000100:00100000:0.0:1787868735.370690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787868735.370699:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939558784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.372144:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939558784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1434us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.372176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787868735.373041:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.373122:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868735.378620:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.378707:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.379038:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939558912 00000100:00100000:0.0:1787868735.379051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939558912 00000100:00100000:0.0:1787868735.379130:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787868735.379143:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939558912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868735.379379:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:6510:x1874715939558912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.379396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787868735.381486:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:6510:1874715939558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868735.382588:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13796:1874715939559040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868735.382681:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868735.382735:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868735.382795:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559040 00000100:00100000:0.0:1787868735.382802:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559040 00000100:00100000:0.0:1787868735.382851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1787868735.382861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:13796:x1874715939559040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868735.383287:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabc05ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:13796:x1874715939559040:12345-0@lo:502:llog_process_th.0 Request processed in 425us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.383296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787868735.383477:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13796:1874715939559040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787868735.383503:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868735.383512:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868735.383514:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787868735.383521:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daa05d8800 00000020:00000080:2.0:1787868735.383523:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787868735.383591:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868735.383595:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868735.383596:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787868735.383599:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868735.383601:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868735.383603:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787868735.383607:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daa05d8800 00000020:00000080:2.0:1787868735.383618:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787868735.383673:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13796:1874715939559168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868735.383717:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868735.383750:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868735.383802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559168 00000100:00100000:3.0:1787868735.383818:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559168 00000100:00100000:3.0:1787868735.383885:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787868735.384215:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:13796:x1874715939559168:12345-0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787868735.384267:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868735.384975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:13796:x1874715939559168:12345-0@lo:502:llog_process_th.0 Request processed in 1077us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868735.384985:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787868735.385465:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:13796:1874715939559168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787868735.385961:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868735.385972:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868735.385982:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787868735.385987:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787868735.386193:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787868735.386292:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868735.386304:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868735.386316:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868735.405094:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868735.586338:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868735.778475:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868735.778501:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939559296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868735.778570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868735.778746:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559296 00000100:00100000:2.0:1787868735.778755:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559296 00000100:00100000:2.0:1787868735.778820:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787868735.778831:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939559296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868735.778858:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868735.778920:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939559296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.778927:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1787868735.778969:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9882d8b40 x1874715939559296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868735.778989:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939559296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868735.779407:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939559424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868735.779558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.779591:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868735.779598:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939559552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868735.779678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.779816:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559424 00000100:00100000:1.0:1787868735.779832:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559424 00000100:00100000:1.0:1787868735.779875:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787868735.779893:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939559424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868735.779910:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868735.779946:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939559424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.779953:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1787868735.780123:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c503c0 x1874715939559424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868735.780139:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939559424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787868735.780248:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868735.780261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559552 00000100:00100000:0.0:1787868735.780265:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559552 00000100:00100000:0.0:1787868735.780303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787868735.780311:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939559552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868735.780346:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787868735.780539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939559552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.780547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787868735.780741:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939559552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868735.781178:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939559936:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.781217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.781248:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939560448:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.781273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.781304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787868735.781310:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939560064:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.781343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868735.781367:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939560576:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.781391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868735.781567:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559936 00000100:00100000:2.0:1787868735.781573:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559936 00000100:00100000:2.0:1787868735.781616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868735.781624:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.781673:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939559936:12345-0@lo:400:kworker.0 Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.781680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868735.781700:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560576 00000100:00100000:2.0:1787868735.781703:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560576 00000100:00100000:2.0:1787868735.781737:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787868735.781744:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939560576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.781786:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939560576:12345-0@lo:400:kworker.0 Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.781792:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787868735.781977:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560448 00000100:00100000:3.0:1787868735.781982:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560448 00000100:00100000:3.0:1787868735.782025:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560064 00000100:00100000:3.0:1787868735.782028:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560064 00000100:00100000:3.0:1787868735.782048:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787868735.782056:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782088:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939560448:12345-0@lo:400:kworker.0 Request processed in 34us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868735.782095:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787868735.782114:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787868735.782119:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782145:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939560064:12345-0@lo:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868735.782151:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787868735.782199:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939559808:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.782244:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939560320:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.782290:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787868735.782297:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939559680:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.782329:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939560192:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.782348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868735.782547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559808 00000100:00100000:2.0:1787868735.782552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559808 00000100:00100000:2.0:1787868735.782571:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560320 00000100:00100000:2.0:1787868735.782573:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560320 00000100:00100000:2.0:1787868735.782586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939559680 00000100:00100000:2.0:1787868735.782588:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939559680 00000100:00100000:2.0:1787868735.782597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560192 00000100:00100000:2.0:1787868735.782599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560192 00000100:00100000:2.0:1787868735.782611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787868735.782617:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939559808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868735.782686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787868735.782695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939560320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.782779:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939560064:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.782792:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939560576:0@lo:400:kworker.0 00000100:00100000:1.0:1787868735.782802:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939559936:0@lo:400:kworker.0 00010000:00080000:1.0:1787868735.782813:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888052c0 x1874715939560448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868735.782851:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939560448:0@lo:400:kworker.0 00000100:00080000:1.0:1787868735.782914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868735.782918:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868735.782921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868735.782938:0:10190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787868735.782945:0:10190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787868735.783057:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787868735.783065:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939559680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.783913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939559808:12345-0@lo:400:kworker.0 Request processed in 1291us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.783922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787868735.783944:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787868735.783952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787868735.783960:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.783997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939560192:12345-0@lo:400:kworker.0 Request processed in 39us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.784073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787868735.784730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939560320:12345-0@lo:400:kworker.0 Request processed in 2034us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868735.784739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787868735.797356:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939559680:12345-0@lo:400:kworker.0 Request processed in 14280us (15024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868735.797380:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:3.0:1787868735.803555:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988806580 x1874715939560192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868735.803575:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939560192:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.803590:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939560704:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.803655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868735.803730:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939559808:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.803743:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939560320:0@lo:400:kworker.0 00000100:00100000:3.0:1787868735.803774:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939559680:0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.804199:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560704 00000100:00100000:2.0:1787868735.804206:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560704 00000100:00100000:2.0:1787868735.804281:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787868735.804291:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939560704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868735.804380:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939560704:12345-0@lo:400:kworker.0 Request processed in 91us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868735.804404:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787868735.804592:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939560704:0@lo:400:kworker.0 00000100:00080000:1.0:1787868735.804714:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868736.289827:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939560960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868736.289938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868736.290191:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939560832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868736.290224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868736.290514:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560832 00000100:00100000:3.0:1787868736.290523:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560832 00000100:00100000:3.0:1787868736.290589:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787868736.290598:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939560832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868736.290625:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868736.290667:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939560832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868736.290675:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787868736.290859:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868736.290868:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939561088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868736.290903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868736.290933:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561088 00000100:00100000:0.0:1787868736.290937:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561088 00000100:00100000:0.0:1787868736.290958:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868736.290963:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939561088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868736.290973:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868736.291012:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939561088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868736.291018:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787868736.291058:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939561088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868736.291093:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939560832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868736.291782:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939560960 00000100:00100000:2.0:1787868736.291787:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939560960 00000100:00100000:2.0:1787868736.291829:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868736.291836:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939560960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868736.291859:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868736.291917:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939560960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868736.291923:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868736.291954:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939560960:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787868736.417923:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787868736.418771:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868736.610753:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868736.730022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730125:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730199:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730223:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730244:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868736.730284:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496768 00000100:00100000:0.0:1787868736.730294:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496768 00000100:00100000:1.0:1787868736.730625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918496896 00000100:00100000:1.0:1787868736.730631:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918496896 00000100:00100000:1.0:1787868736.730686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497408 00000100:00100000:1.0:1787868736.730689:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497408 00000100:00100000:1.0:1787868736.730702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497024 00000100:00100000:1.0:1787868736.730705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497024 00000100:00100000:1.0:1787868736.730716:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497280 00000100:00100000:1.0:1787868736.730718:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497280 00000100:00100000:1.0:1787868736.730734:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1787868736.730745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918496896:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868736.730824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918496896:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 82us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868736.730824:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:1.0:1787868736.730832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:0.0:1787868736.730832:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918496768:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868736.730849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:0.0:1787868736.730858:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918496768:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868736.730865:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918497408:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868736.730865:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:0.0:1787868736.730909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:0.0:1787868736.730916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918497024:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868736.730918:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918497408:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 54us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868736.730924:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:1.0:1787868736.730936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:0.0:1787868736.730939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918497024:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868736.730942:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918497280:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868736.730945:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:1.0:1787868736.730963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918497280:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868736.730969:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00080000:0.0:1787868736.730978:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868736.730982:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868736.731714:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497152 00000100:00100000:3.0:1787868736.731722:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497152 00000100:00100000:3.0:1787868736.731790:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1787868736.731799:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918497152:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868736.731840:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918497152:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 44us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868736.731846:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00080000:0.0:1787868736.733254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787868737.635735:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868738.657635:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787868738.853256:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1787868739.682976:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868740.705438:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868740.897512:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939561216:0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.897535:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939561472:0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.897598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868740.897670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939561984:0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.897710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868740.897736:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939562496:0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.897777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868740.897887:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939561344:0@lo:400:kworker.0 00000100:00100000:1.0:1787868740.897921:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561984 00000100:00100000:1.0:1787868740.897929:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561984 00000100:00100000:1.0:1787868740.897985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562496 00000100:00100000:1.0:1787868740.897987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562496 00000100:00100000:1.0:1787868740.898008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787868740.898016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939561984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.900998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.901067:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939561728:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.902484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.902924:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939562240:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.902975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.903047:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939562752:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.903073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.903135:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561216 00000100:00100000:3.0:1787868740.903141:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561216 00000100:00100000:3.0:1787868740.903207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787868740.903216:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.903291:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939561216:12345-0@lo:400:kworker.0 Request processed in 66us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.903413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787868740.903450:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561472 00000100:00100000:3.0:1787868740.903454:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561472 00000100:00100000:3.0:1787868740.903479:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561728 00000100:00100000:3.0:1787868740.903481:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561728 00000100:00100000:3.0:1787868740.903494:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787868740.903501:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939561472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.903549:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939561472:12345-0@lo:400:kworker.0 Request processed in 39us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.903555:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787868740.903575:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787868740.903580:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939561728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.903610:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939561728:12345-0@lo:400:kworker.0 Request processed in 30us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.903616:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787868740.903633:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562240 00000100:00100000:3.0:1787868740.903636:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562240 00000100:00100000:3.0:1787868740.903963:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562752 00000100:00100000:3.0:1787868740.903967:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562752 00000100:00100000:3.0:1787868740.903991:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868740.903998:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939562240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.904032:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939562240:12345-0@lo:400:kworker.0 Request processed in 34us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.904038:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868740.904050:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787868740.904055:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939562752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.904085:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939562752:12345-0@lo:400:kworker.0 Request processed in 30us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.904091:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787868740.904182:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939561600:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.904239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.904263:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939562112:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.904737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.904760:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939562624:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.904797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.904815:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939563136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868740.904909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.904934:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868740.904941:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939563008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868740.904967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.904998:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562112 00000100:00100000:3.0:1787868740.905002:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562112 00000100:00100000:3.0:1787868740.905028:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562624 00000100:00100000:3.0:1787868740.905040:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562624 00000100:00100000:3.0:1787868740.905059:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868740.905065:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939562112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.905102:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939562112:12345-0@lo:400:kworker.0 Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.905108:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868740.905452:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868740.905461:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939562624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.905494:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939562624:12345-0@lo:400:kworker.0 Request processed in 36us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.905501:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787868740.905524:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563136 00000100:00100000:3.0:1787868740.905528:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563136 00000100:00100000:3.0:1787868740.905771:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787868740.905781:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939563136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868740.905823:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868740.905835:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939561472:0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.905870:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561600 00000100:00100000:2.0:1787868740.905875:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561600 00000100:00100000:2.0:1787868740.905899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787868740.905907:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939562496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.905950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939562496:12345-0@lo:400:kworker.0 Request processed in 44us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868740.905968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787868740.905985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787868740.905993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939561600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.905997:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939563136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 217us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.906007:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787868740.906031:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563008 00000100:00100000:2.0:1787868740.906035:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939561600:12345-0@lo:400:kworker.0 Request processed in 43us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.906036:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563008 00000100:00100000:2.0:1787868740.906045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787868740.906074:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787868740.906085:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939563008:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787868740.906085:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c3840 x1874715939562496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1787868740.906105:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868740.906225:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939563008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.906243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1787868740.906446:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c503c0 x1874715939563008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868740.906463:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939563008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868740.906479:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939561600:0@lo:400:kworker.0 00010000:00080000:3.0:1787868740.906492:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93090780 x1874715939562112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868740.906503:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939562112:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.906521:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939562624:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906540:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939561856:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868740.906577:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939562368:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868740.906754:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939563136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868740.906815:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939562880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868740.906818:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787868740.906826:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9882d9e00, transno 4294967301 00000100:00100000:0.0:1787868740.906863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868740.906899:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868740.906904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868740.906906:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868740.906916:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562880 00000100:00100000:0.0:1787868740.906921:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562880 00000100:00100000:3.0:1787868740.906939:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939562752:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906953:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787868740.906959:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939561216:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.906964:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939562880:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868740.906977:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939561728:0@lo:400:kworker.0 00002000:00000024:0.0:1787868740.906980:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787868740.906991:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93091a40 x1874715939562240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868740.907001:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939562240:0@lo:400:kworker.0 00000100:00100000:0.0:1787868740.907022:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939562880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868740.907029:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787868740.907044:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561344 00000100:00100000:3.0:1787868740.907049:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561344 00000100:00100000:0.0:1787868740.907052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939561856 00000100:00100000:0.0:1787868740.907058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939561856 00000100:00100000:3.0:1787868740.907072:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939562368 00000100:00100000:3.0:1787868740.907077:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939562368 00000100:00100000:0.0:1787868740.907103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787868740.907116:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939561344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868740.907190:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939562496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868740.907191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939561984:12345-0@lo:400:kworker.0 Request processed in 9173us (9478us total) trans 0 rc 0/0 00010000:00080000:2.0:1787868740.907220:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888043c0 x1874715939561984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868740.907230:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939561984:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.907434:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787868740.907442:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939561856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.907483:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939561856:12345-0@lo:400:kworker.0 Request processed in 43us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.907490:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787868740.907502:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787868740.907508:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939562368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.907904:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939562368:12345-0@lo:400:kworker.0 Request processed in 32us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868740.907912:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787868740.907977:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939561856:0@lo:400:kworker.0 00000100:00100000:3.0:1787868740.907988:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939562368:0@lo:400:kworker.0 00010000:00080000:3.0:1787868740.907998:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98733b0c0 x1874715939562880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868740.908012:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939562880:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787868740.908040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868740.908085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787868740.919053:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939561344:12345-0@lo:400:kworker.0 Request processed in 11931us (12539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868740.919070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787868740.920720:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939561344:0@lo:400:kworker.0 00000100:00100000:1.0:1787868741.410759:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939563392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868741.410880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868741.410994:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868741.411001:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939563264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868741.411037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868741.411075:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563392 00000100:00100000:1.0:1787868741.411083:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563392 00000100:00100000:1.0:1787868741.411136:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563264 00000100:00100000:1.0:1787868741.411153:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563264 00000100:00100000:1.0:1787868741.411200:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787868741.411209:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939563392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868741.411240:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868741.411285:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939563392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868741.411294:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787868741.411312:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787868741.411319:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939563264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868741.411328:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868741.411349:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939563264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868741.411355:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787868741.411392:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939563264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868741.411405:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939563392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868741.412061:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939563520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868741.412120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868741.412481:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563520 00000100:00100000:0.0:1787868741.412487:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563520 00000100:00100000:0.0:1787868741.412528:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787868741.412536:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939563520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868741.412589:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868741.412649:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939563520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868741.412678:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787868741.413075:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939563520:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787868741.729921:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868741.849890:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868741.850075:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868741.850182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497536 00000100:00100000:3.0:1787868741.850193:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497536 00000100:00100000:3.0:1787868741.850249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00100000:3.0:1787868741.850260:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918497536:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868741.850333:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918497536:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 75us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868741.850341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00100000:1.0:1787868741.850674:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868741.855994:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868741.857205:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497792 00000100:00100000:2.0:1787868741.857218:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497792 00000100:00100000:2.0:1787868741.857287:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498048 00000100:00100000:2.0:1787868741.857291:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498048 00000100:00100000:2.0:1787868741.860609:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 265 00000100:00100000:2.0:1787868741.860724:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497792:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868741.861145:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497792:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 519us (11067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868741.861456:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868741.861489:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868741.862264:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 265 00000100:00100000:2.0:1787868741.862305:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497664 00000100:00100000:2.0:1787868741.862313:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497664 00000100:00100000:2.0:1787868741.862347:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498176 00000100:00100000:2.0:1787868741.862350:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498176 00000100:00100000:2.0:1787868741.862369:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:2.0:1787868741.862377:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498048:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868741.862444:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498048:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 66us (11769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868741.862452:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:2.0:1787868741.862510:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 267 00000100:00100000:2.0:1787868741.862529:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497664:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868741.862567:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497664:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 51us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868741.862574:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 267 00000100:00100000:2.0:1787868741.862586:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00100000:2.0:1787868741.862592:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498176:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868741.862616:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498176:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868741.862637:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00080000:2.0:1787868741.862702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868741.862706:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868741.862732:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918497920 00000100:00100000:2.0:1787868741.862736:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918497920 00000100:00100000:2.0:1787868741.862783:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:2.0:1787868741.862797:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497920:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868741.863122:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918497920:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 324us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868741.863130:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00080000:2.0:1787868741.863148:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787868742.753448:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868743.777415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868744.802952:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868745.826136:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868746.017520:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868746.017547:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939563776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868746.017619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868746.017702:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563776 00000100:00100000:1.0:1787868746.017709:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563776 00000100:00100000:1.0:1787868746.017771:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787868746.017779:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939563776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868746.017804:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868746.017845:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939563776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.017852:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1787868746.017888:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbda40 x1874715939563776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868746.017908:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939563776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868746.018254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939563648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868746.018287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868746.018320:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868746.018427:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563648 00000100:00100000:1.0:1787868746.018431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563648 00000100:00100000:1.0:1787868746.018460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787868746.018466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939563648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868746.018489:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868746.018525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939563648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.018532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787868746.018746:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939564288:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.018789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.018809:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939564800:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.018834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.018858:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868746.018864:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939563904:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.018890:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.018910:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939564416:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.018932:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.018947:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939564928:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.018966:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.018991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564288 00000100:00100000:3.0:1787868746.018995:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564288 00000100:00100000:3.0:1787868746.019035:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787868746.019041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939564288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.019072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939564288:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868746.019078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787868746.019225:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939563904 00000100:00100000:1.0:1787868746.019229:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939563904 00000100:00100000:1.0:1787868746.019257:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787868746.019264:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939563904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.019294:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939563904:12345-0@lo:400:kworker.0 Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.019301:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787868746.019510:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939563904:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.019524:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939564288:0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.019811:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564800 00000100:00100000:2.0:1787868746.019816:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564800 00000100:00100000:2.0:1787868746.019863:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564416 00000100:00100000:2.0:1787868746.019867:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564416 00000100:00100000:2.0:1787868746.019885:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564928 00000100:00100000:2.0:1787868746.019888:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564928 00000100:00100000:2.0:1787868746.019902:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787868746.019909:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939564800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.019947:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939564800:12345-0@lo:400:kworker.0 Request processed in 39us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.019953:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787868746.019964:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787868746.019969:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939564416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.019991:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939564416:12345-0@lo:400:kworker.0 Request processed in 22us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.019996:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787868746.020018:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787868746.020024:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.020061:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939564928:12345-0@lo:400:kworker.0 Request processed in 37us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.020067:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787868746.020103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939564032:0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.020129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868746.020355:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564032 00000100:00100000:1.0:1787868746.020359:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564032 00000100:00100000:1.0:1787868746.020392:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787868746.020398:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939564032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868746.020533:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868746.020544:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939565312:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787868746.020615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868746.020625:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868746.020650:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939564160:0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.021374:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939564032:12345-0@lo:400:kworker.0 Request processed in 973us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.021382:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787868746.021461:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939564416:0@lo:400:kworker.0 00010000:00080000:1.0:1787868746.021476:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93090780 x1874715939564928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868746.021486:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939564928:0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.021497:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939564800:0@lo:400:kworker.0 00000100:00100000:0.0:1787868746.021660:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868746.021755:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565312 00000100:00100000:1.0:1787868746.021762:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565312 00000100:00100000:1.0:1787868746.021815:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787868746.021823:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939565312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868746.021843:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868746.021884:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939565312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.021892:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787868746.021951:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787868746.021970:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9883861c0 x1874715939565312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868746.021987:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939565312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868746.027020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939564032:0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.027038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939564544:0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.027285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868746.027313:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939565056:0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.027344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868746.027561:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564544 00000100:00100000:0.0:1787868746.027568:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564544 00000100:00100000:0.0:1787868746.027652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787868746.027663:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939564544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868746.027744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939564544:12345-0@lo:400:kworker.0 Request processed in 82us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868746.027751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1787868746.027831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787868746.027853:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1680 x1874715939564544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868746.027865:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939564544:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.027943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.027976:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939564672:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.028004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868746.028044:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564160 00000100:00100000:2.0:1787868746.028048:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564160 00000100:00100000:2.0:1787868746.028092:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787868746.028100:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939564160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868746.028135:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939564160:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.028141:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787868746.034380:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939565184:0@lo:400:kworker.0 00000100:00100000:3.0:1787868746.034450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868746.034571:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565056 00000100:00100000:1.0:1787868746.034580:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565056 00000100:00100000:1.0:1787868746.034655:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939564672 00000100:00100000:1.0:1787868746.034659:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939564672 00000100:00100000:1.0:1787868746.034683:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787868746.034704:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.034776:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939565056:12345-0@lo:400:kworker.0 Request processed in 73us (7430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.034797:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787868746.034813:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787868746.034820:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939564672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.034852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939564672:12345-0@lo:400:kworker.0 Request processed in 33us (6847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.034857:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787868746.034943:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939565056:0@lo:400:kworker.0 00000100:00080000:0.0:1787868746.035771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868746.038775:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939563648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868746.038816:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939564160:0@lo:400:kworker.0 00010000:00080000:3.0:1787868746.038831:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1e00 x1874715939564672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868746.038842:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939564672:0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.038915:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565184 00000100:00100000:1.0:1787868746.038922:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565184 00000100:00100000:1.0:1787868746.039001:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787868746.039011:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939565184:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787868746.039179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868746.039282:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939565184:0@lo:400:kworker.0 00000100:00100000:1.0:1787868746.039352:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939565184:12345-0@lo:400:kworker.0 Request processed in 71us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868746.039361:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787868746.533497:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868746.533522:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939565440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868746.533601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868746.534118:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565440 00000100:00100000:2.0:1787868746.534126:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565440 00000100:00100000:2.0:1787868746.534195:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787868746.534205:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939565440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868746.534251:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868746.534459:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939565440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.534468:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787868746.534522:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939565440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868746.534618:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868746.534629:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939565568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868746.534664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868746.534823:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565568 00000100:00100000:2.0:1787868746.534828:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565568 00000100:00100000:2.0:1787868746.534861:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787868746.534868:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939565568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868746.534879:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868746.534918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939565568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868746.534924:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787868746.534989:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939565568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868746.535145:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939565696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868746.535191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868746.535256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565696 00000100:00100000:3.0:1787868746.535261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565696 00000100:00100000:3.0:1787868746.535295:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787868746.535303:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939565696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868746.535324:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868746.535363:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939565696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868746.535369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787868746.535438:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939565696:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787868746.657840:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787868746.658755:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868746.849934:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868746.995403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868746.995522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868746.995562:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868747.007661:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498560 00000100:00100000:1.0:1787868747.007721:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498560 00000100:00100000:1.0:1787868747.007952:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498432 00000100:00100000:1.0:1787868747.007970:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498432 00000100:00100000:1.0:1787868747.008050:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 275 00000100:00100000:1.0:1787868747.008081:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918498560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868747.008297:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918498560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 237us (12784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868747.008305:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 275 00000100:00100000:1.0:1787868747.008337:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:1.0:1787868747.008344:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918498432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868747.008386:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918498432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (12808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868747.008408:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:3.0:1787868747.008881:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498304 00000100:00100000:3.0:1787868747.008888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498304 00000100:00100000:3.0:1787868747.009023:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 377 00000100:00100000:3.0:1787868747.009034:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918498304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868747.009181:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918498304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 150us (13789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868747.009206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 377 00000100:00080000:2.0:1787868747.014371:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868747.014381:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868747.016227:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868747.016271:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868747.016292:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868747.016374:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498688 00000100:00100000:3.0:1787868747.016398:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498688 00000100:00100000:3.0:1787868747.016478:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1787868747.016489:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918498688:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:3.0:1787868747.016519:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d23e 00000100:00080000:3.0:1787868747.016528:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787868747.016574:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787868747.016754:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+2:2402:x1874715918498688:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 267us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868747.016775:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00010000:00010000:3.0:1787868747.016801:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787868747.017205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868747.017459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498944 00000100:00100000:1.0:1787868747.017467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498944 00000100:00100000:1.0:1787868747.017525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918498816 00000100:00100000:1.0:1787868747.017529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918498816 00000100:00100000:1.0:1787868747.017553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:1.0:1787868747.017562:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498944:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868747.017618:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498944:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868747.017625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:1.0:1787868747.017639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:1.0:1787868747.017646:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868747.017684:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918498816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868747.017708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00080000:2.0:1787868747.017892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868747.017896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787868747.873497:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868748.897388:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868749.921742:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868750.946397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868751.137399:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939565824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868751.137475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.137641:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565824 00000100:00100000:1.0:1787868751.137657:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565824 00000100:00100000:1.0:1787868751.137732:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787868751.137742:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939565824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868751.137775:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868751.142523:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939566336:0@lo:400:kworker.0 00000100:00100000:2.0:1787868751.142643:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.142998:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939565824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5256us (5521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.143021:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787868751.143070:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939566208:0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.143127:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868751.143133:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939566080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.143210:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566208 00000100:00100000:1.0:1787868751.143217:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566208 00000100:00100000:1.0:1787868751.143252:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787868751.143258:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939566208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143303:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939566208:12345-0@lo:400:kworker.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.143309:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787868751.143324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566080 00000100:00100000:1.0:1787868751.143327:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566080 00000100:00100000:1.0:1787868751.143349:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787868751.143367:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939566080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143395:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939566080:12345-0@lo:400:kworker.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.143408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787868751.143454:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939566080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143467:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939566208:0@lo:400:kworker.0 00000100:00080000:1.0:1787868751.143544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868751.143562:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566336 00000100:00100000:1.0:1787868751.143566:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566336 00000100:00100000:1.0:1787868751.143601:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787868751.143608:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939566336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.143641:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939566336:12345-0@lo:400:kworker.0 Request processed in 34us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.143656:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787868751.143682:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939565952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868751.143721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.143740:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939566464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868751.143760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.143798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566464 00000100:00100000:1.0:1787868751.143802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566464 00000100:00100000:1.0:1787868751.143822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868751.143829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939566464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868751.143852:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787868751.143890:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939566464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.143897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868751.143925:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939566464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868751.143966:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939565952 00000100:00100000:1.0:1787868751.143970:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939565952 00000100:00100000:1.0:1787868751.143999:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787868751.144005:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939565952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868751.144017:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868751.144048:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939565952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.144053:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787868751.144065:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787868751.144082:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da90f74b40 x1874715939565952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868751.144097:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939565952:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787868751.148617:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9883870c0 x1874715939565824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868751.148773:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939565824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868751.148819:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939566336:0@lo:400:kworker.0 00000100:00100000:2.0:1787868751.151190:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939566592:0@lo:400:kworker.0 00000100:00100000:2.0:1787868751.151260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868751.151424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566592 00000100:00100000:3.0:1787868751.151432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566592 00000100:00100000:3.0:1787868751.151490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787868751.151501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939566592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.151928:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939566720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.151964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868751.152001:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566720 00000100:00100000:1.0:1787868751.152005:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566720 00000100:00100000:1.0:1787868751.152042:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787868751.152050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939566720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868751.152084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939566720:12345-0@lo:400:kworker.0 Request processed in 36us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868751.152092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787868751.152130:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939566720:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.152725:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939567232:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.152760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.152782:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868751.152792:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939567104:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.152812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.152836:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567232 00000100:00100000:0.0:1787868751.152839:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567232 00000100:00100000:0.0:1787868751.152873:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567104 00000100:00100000:0.0:1787868751.152876:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567104 00000100:00100000:0.0:1787868751.152902:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787868751.152908:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939567232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.152950:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939567232:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.152955:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787868751.152966:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787868751.152971:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939567104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.152994:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939567104:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.152999:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1787868751.153014:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868751.153017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868751.153048:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939567104:0@lo:400:kworker.0 00010000:00080000:0.0:1787868751.153061:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988384000 x1874715939567232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868751.153071:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939567232:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153107:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939566976:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.153148:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939567488:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.153212:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787868751.153217:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939566848:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.153252:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939567360:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153289:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.153312:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566976 00000100:00100000:0.0:1787868751.153316:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566976 00000100:00100000:0.0:1787868751.153336:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939566848 00000100:00100000:0.0:1787868751.153339:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939566848 00000100:00100000:0.0:1787868751.153365:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787868751.153371:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939566976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153400:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939566976:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.153407:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787868751.153418:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787868751.153423:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939566848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153447:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939566848:12345-0@lo:400:kworker.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.153453:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1787868751.153466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868751.153469:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868751.153483:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939566848:0@lo:400:kworker.0 00010000:00080000:0.0:1787868751.153492:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988384b40 x1874715939566976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868751.153501:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939566976:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153527:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567488 00000100:00100000:0.0:1787868751.153530:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567488 00000100:00100000:0.0:1787868751.153558:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567360 00000100:00100000:0.0:1787868751.153560:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567360 00000100:00100000:0.0:1787868751.153577:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787868751.153583:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988385e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939567488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153635:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988385e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939567488:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.153642:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787868751.153652:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787868751.153658:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939567360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153684:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939567360:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.153690:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787868751.153703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868751.153718:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939567360:0@lo:400:kworker.0 00000100:00100000:0.0:1787868751.153728:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939567488:0@lo:400:kworker.0 00000100:00100000:3.0:1787868751.154394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939566592:12345-0@lo:400:kworker.0 Request processed in 2891us (3129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868751.154402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787868751.155229:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939566592:0@lo:400:kworker.0 00000100:00100000:2.0:1787868751.651096:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939567616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868751.651184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868751.651269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567616 00000100:00100000:2.0:1787868751.651277:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567616 00000100:00100000:2.0:1787868751.651323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787868751.651331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939567616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868751.651379:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868751.651426:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939567616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868751.651434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787868751.651485:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939567616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868751.652525:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939567744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868751.652587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868751.652654:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567744 00000100:00100000:0.0:1787868751.652660:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567744 00000100:00100000:0.0:1787868751.652716:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787868751.652725:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939567744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868751.653553:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868751.653642:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939567744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 917us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868751.653651:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787868751.654040:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939567744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868751.655127:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939567872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868751.655246:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868751.656260:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939567872 00000100:00100000:2.0:1787868751.656270:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939567872 00000100:00100000:2.0:1787868751.656320:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787868751.656331:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939567872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868751.658294:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868751.660073:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939567872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3734us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868751.660087:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787868751.660673:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939567872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787868751.975098:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868752.093384:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868752.093428:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868752.093452:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868752.093480:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499200 00000100:00100000:2.0:1787868752.093490:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868752.093492:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499200 00000100:00100000:3.0:1787868752.093517:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499328 00000100:00100000:3.0:1787868752.093524:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499328 00000100:00100000:2.0:1787868752.093529:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868752.093564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499456 00000100:00100000:3.0:1787868752.093568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499456 00000100:00100000:1.0:1787868752.093625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499072 00000100:00100000:1.0:1787868752.093631:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499072 00000100:00100000:1.0:1787868752.093678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 379 00000100:00100000:1.0:1787868752.093690:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918499072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868752.093765:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918499072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868752.093773:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 379 00000100:00080000:1.0:1787868752.093824:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868752.093828:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868752.095100:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499584 00000100:00100000:0.0:1787868752.095110:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499584 00000100:00100000:2.0:1787868752.095114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 285 00000100:00100000:2.0:1787868752.095137:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868752.095209:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 86us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868752.095217:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 285 00000100:00100000:2.0:1787868752.095277:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:0.0:1787868752.095285:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:2.0:1787868752.095287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918499200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868752.095317:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918499456:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868752.095322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918499200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868752.095330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:2.0:1787868752.095346:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:2.0:1787868752.095352:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918499584:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868752.095427:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918499456:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 114us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868752.095431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918499584:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868752.095440:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:2.0:1787868752.095447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00080000:0.0:1787868752.095473:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1787868752.675202:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:2.0:1787868752.675212:0:9508:0:(genops.c:885:class_export_put()) final put ffff93dab7f77800/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:0.0:1787868752.675627:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7f77800/666039a7-1461-4e99-8c4e-10237114565a for lustre-OST0001 00000020:00000080:0.0:1787868752.675696:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7f72000 for lustre-OST0001 00010000:00010000:3.0:1787868752.996355:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868754.018990:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868755.041365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868756.067667:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868756.257927:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868756.257954:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868756.258026:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868756.258099:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568000 00000100:00100000:1.0:1787868756.258107:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568000 00000100:00100000:1.0:1787868756.258189:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787868756.258199:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939568000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868756.258228:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868756.258271:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939568000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868756.258278:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787868756.258299:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787868756.258328:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f570c0 x1874715939568000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868756.258347:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868756.258564:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939568128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868756.258607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.258644:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568128 00000100:00100000:2.0:1787868756.258647:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568128 00000100:00100000:2.0:1787868756.258676:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787868756.258682:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939568128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868756.258705:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868756.258736:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939568128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.258742:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787868756.258770:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939568128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868756.259531:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939568512:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.259576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868756.259732:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939568256:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.259767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868756.259803:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939568768:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.259874:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939569024:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.259897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.259916:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939569536:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.259936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.259954:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787868756.259959:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939568384:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.259977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.259992:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939568896:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.260034:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939569408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868756.260079:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568512 00000100:00100000:2.0:1787868756.260083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568512 00000100:00100000:2.0:1787868756.260114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568384 00000100:00100000:2.0:1787868756.260117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568384 00000100:00100000:2.0:1787868756.260133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568896 00000100:00100000:2.0:1787868756.260136:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568896 00000100:00100000:2.0:1787868756.260181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787868756.260189:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939568512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260233:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939568512:12345-0@lo:400:kworker.0 Request processed in 45us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.260240:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787868756.260254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787868756.260260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939568384:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.260292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787868756.260302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787868756.260308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260334:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939568896:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.260340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787868756.260359:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569024 00000100:00100000:2.0:1787868756.260362:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569024 00000100:00100000:2.0:1787868756.260387:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569536 00000100:00100000:2.0:1787868756.260391:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569536 00000100:00100000:2.0:1787868756.260404:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569408 00000100:00100000:2.0:1787868756.260412:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569408 00000100:00100000:2.0:1787868756.260442:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787868756.260449:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260479:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939569024:12345-0@lo:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.260485:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787868756.260507:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787868756.260512:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939569536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.260548:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939569536:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.260553:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787868756.260563:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787868756.260568:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939569408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868756.260971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568256 00000100:00100000:1.0:1787868756.260982:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568256 00000100:00100000:1.0:1787868756.261013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787868756.261021:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939568256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868756.262511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939568640:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.262770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868756.262809:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939569280:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.262851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868756.264071:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939568256:12345-0@lo:400:kworker.0 Request processed in 3045us (4297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868756.264084:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787868756.264133:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568768 00000100:00100000:1.0:1787868756.264140:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568768 00000100:00100000:1.0:1787868756.264194:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569280 00000100:00100000:1.0:1787868756.264198:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569280 00000100:00100000:1.0:1787868756.264215:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787868756.264223:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939568768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868756.264269:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939568768:12345-0@lo:400:kworker.0 Request processed in 47us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868756.264275:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787868756.264287:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787868756.264293:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939569280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868756.264321:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939569280:12345-0@lo:400:kworker.0 Request processed in 28us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868756.264327:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787868756.265113:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939568256:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.265129:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988805680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939568768:0@lo:400:kworker.0 00010000:00080000:0.0:1787868756.265141:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988a15680 x1874715939569280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868756.265152:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939569280:0@lo:400:kworker.0 00000100:00080000:0.0:1787868756.266888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868756.266896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868756.266899:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868756.266902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868756.266950:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939568384:0@lo:400:kworker.0 00010000:00080000:0.0:1787868756.266967:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888061c0 x1874715939568896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868756.266992:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939568896:0@lo:400:kworker.0 00000100:00100000:2.0:1787868756.267883:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939569408:12345-0@lo:400:kworker.0 Request processed in 7310us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868756.267895:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787868756.269859:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939569408:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.269879:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939568512:0@lo:400:kworker.0 00010000:00080000:0.0:1787868756.269893:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9336a1c0 x1874715939569024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868756.269904:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787868756.269916:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939569536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868756.279482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868756.279550:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939568640 00000100:00100000:3.0:1787868756.279559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939568640 00000100:00100000:3.0:1787868756.279617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787868756.279627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939568640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868756.279678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939568640:12345-0@lo:400:kworker.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868756.279685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787868756.279727:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988807c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939568640:0@lo:400:kworker.0 00000100:00100000:3.0:1787868756.279738:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939569152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868756.279764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868756.279787:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939569664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868756.279808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868756.279827:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569664 00000100:00100000:3.0:1787868756.279830:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569664 00000100:00100000:3.0:1787868756.279854:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787868756.279868:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939569664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868756.279884:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868756.279910:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939569664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868756.279916:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1787868756.279963:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f570c0 x1874715939569664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868756.279980:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939569664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868756.293533:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569152 00000100:00100000:1.0:1787868756.293558:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569152 00000100:00100000:1.0:1787868756.293758:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787868756.293769:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939569152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868756.293862:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939569152:12345-0@lo:400:kworker.0 Request processed in 96us (14097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868756.293869:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787868756.293989:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939569152:0@lo:400:kworker.0 00000100:00080000:0.0:1787868756.294328:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868756.769441:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939569920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868756.769449:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939569792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868756.777296:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939570048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868756.777434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868756.777494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569792 00000100:00100000:0.0:1787868756.777503:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569792 00000100:00100000:0.0:1787868756.777561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787868756.777572:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939569792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868756.777620:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787868756.777664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939569792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868756.777672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787868756.777764:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939569792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868756.778431:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868756.779931:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939569920 00000100:00100000:0.0:1787868756.779942:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939569920 00000100:00100000:0.0:1787868756.780009:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787868756.780019:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939569920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868756.780068:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868756.780187:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939569920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868756.780194:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787868756.780417:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939569920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868756.787377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868756.787555:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570048 00000100:00100000:3.0:1787868756.787568:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570048 00000100:00100000:3.0:1787868756.787642:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787868756.787653:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939570048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868756.787679:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868756.787731:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939570048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868756.787739:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787868756.788216:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939570048:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787868756.898954:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787868756.909256:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787868757.093723:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868757.214796:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868757.214847:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868757.214932:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868757.214973:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868757.215006:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868757.215035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499840 00000100:00100000:1.0:1787868757.215045:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499840 00000100:00100000:1.0:1787868757.215121:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500096 00000100:00100000:1.0:1787868757.215125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500096 00000100:00100000:1.0:1787868757.215143:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499968 00000100:00100000:1.0:1787868757.215146:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499968 00000100:00100000:1.0:1787868757.215177:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500224 00000100:00100000:1.0:1787868757.215180:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500224 00000100:00100000:1.0:1787868757.215203:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1787868757.215215:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499840:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868757.215309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499840:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 96us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868757.215317:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1787868757.215336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:1.0:1787868757.215342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500096:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868757.215368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500096:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868757.215374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:1.0:1787868757.215386:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:1.0:1787868757.215401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499968:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868757.216798:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918499968:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1383us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868757.216820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:1.0:1787868757.216856:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:1.0:1787868757.216879:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868757.216980:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 117us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868757.216986:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:1.0:1787868757.217050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918499712 00000100:00100000:1.0:1787868757.217068:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918499712 00000100:00100000:1.0:1787868757.217122:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 381 00000100:00100000:1.0:1787868757.217130:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918499712:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868757.217172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918499712:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868757.217179:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 381 00000100:00080000:1.0:1787868757.217247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868757.217252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787868758.113318:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868759.137329:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868760.161409:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787868761.014630:0:14059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:12:39 (1787868759) 00010000:00010000:3.0:1787868761.185354:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868761.377511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939570176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868761.377594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.377866:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939570432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868761.377872:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939570304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868761.377951:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570176 00000100:00100000:1.0:1787868761.377959:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570176 00000100:00100000:1.0:1787868761.378017:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787868761.378028:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939570176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868761.378057:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868761.378180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.378196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.378245:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570304 00000100:00100000:0.0:1787868761.378249:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570304 00000100:00100000:2.0:1787868761.378255:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570432 00000100:00100000:2.0:1787868761.378261:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570432 00000100:00100000:2.0:1787868761.378298:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787868761.378299:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787868761.378311:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939570432:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868761.378313:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939570304:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787868761.378328:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1787868761.378343:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787868761.378368:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939570432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868761.378377:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787868761.378406:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939570304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.378415:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00080000:2.0:1787868761.378439:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988a152c0 x1874715939570432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868761.378464:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939570304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868761.378465:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939570432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787868761.378518:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868761.378601:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939570176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 576us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868761.378608:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787868761.378991:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939570688:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.379067:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939571200:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.379105:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939571712:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787868761.379150:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f56580 x1874715939570176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868761.379186:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939570176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868761.379209:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787868761.379215:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939570816:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.379271:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939571328:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.379327:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570688 00000100:00100000:0.0:1787868761.379331:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570688 00000100:00100000:0.0:1787868761.379362:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571200 00000100:00100000:0.0:1787868761.379365:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571200 00000100:00100000:0.0:1787868761.379387:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570816 00000100:00100000:0.0:1787868761.379401:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570816 00000100:00100000:0.0:1787868761.379415:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571328 00000100:00100000:0.0:1787868761.379417:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571328 00000100:00100000:0.0:1787868761.379430:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787868761.379437:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939570688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379476:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939570688:12345-0@lo:400:kworker.0 Request processed in 39us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.379483:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787868761.379495:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787868761.379501:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939571200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379528:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939571200:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.379535:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787868761.379546:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787868761.379552:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939570816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379577:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939570816:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.379593:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787868761.379605:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787868761.379611:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939571328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.379640:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939571328:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868761.379828:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571712 00000100:00100000:3.0:1787868761.379833:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571712 00000100:00100000:3.0:1787868761.379878:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787868761.379886:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939571712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868761.379928:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939571712:12345-0@lo:400:kworker.0 Request processed in 44us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868761.379935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1787868761.379979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868761.379983:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868761.379986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868761.380012:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939570816:0@lo:400:kworker.0 00000100:00100000:3.0:1787868761.380021:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939571328:0@lo:400:kworker.0 00000100:00100000:3.0:1787868761.380028:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939570688:0@lo:400:kworker.0 00010000:00080000:3.0:1787868761.380038:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1e00 x1874715939571200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868761.380046:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939571200:0@lo:400:kworker.0 00000100:00100000:3.0:1787868761.380054:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939571712:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.380741:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787868761.381086:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939570560:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.381147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.381218:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939571072:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.381244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.381271:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939571584:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.381747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.381776:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787868761.381784:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939570944:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.381811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.382768:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939571456:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.382824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868761.383376:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570944 00000100:00100000:2.0:1787868761.383385:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570944 00000100:00100000:2.0:1787868761.383606:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787868761.383630:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939570944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.383869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571072 00000100:00100000:1.0:1787868761.383874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571072 00000100:00100000:1.0:1787868761.383925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571456 00000100:00100000:1.0:1787868761.383928:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571456 00000100:00100000:1.0:1787868761.383958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787868761.383965:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939571072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.384039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939571072:12345-0@lo:400:kworker.0 Request processed in 75us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868761.384046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787868761.384062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787868761.384068:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939571456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.384097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939571456:12345-0@lo:400:kworker.0 Request processed in 29us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868761.384102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1787868761.384122:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868761.384126:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787868761.384185:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c3840 x1874715939571456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868761.384198:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939571456:0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.384212:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939571072:0@lo:400:kworker.0 00000100:00100000:2.0:1787868761.384788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939570944:12345-0@lo:400:kworker.0 Request processed in 1157us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868761.384796:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868761.385273:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939570560 00000100:00100000:0.0:1787868761.385280:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939570560 00000100:00100000:0.0:1787868761.385333:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787868761.385341:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939570560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.385383:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939570560:12345-0@lo:400:kworker.0 Request processed in 44us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.385400:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787868761.385438:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571584 00000100:00100000:0.0:1787868761.385441:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571584 00000100:00100000:0.0:1787868761.385488:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787868761.385494:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.385526:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939571584:12345-0@lo:400:kworker.0 Request processed in 32us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.385532:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787868761.385595:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868761.386637:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939570944:0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.386665:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939570560:0@lo:400:kworker.0 00000100:00100000:1.0:1787868761.386705:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939571584:0@lo:400:kworker.0 00000100:00100000:0.0:1787868761.889859:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939571840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868761.889948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868761.890306:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571840 00000100:00100000:3.0:1787868761.890315:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571840 00000100:00100000:3.0:1787868761.890371:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787868761.890393:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939571840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868761.890425:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868761.890488:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939571840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868761.890496:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787868761.890871:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939571840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868761.894579:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868761.894607:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939571968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868761.894679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868761.894740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939571968 00000100:00100000:1.0:1787868761.894747:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939571968 00000100:00100000:1.0:1787868761.894802:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787868761.894813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939571968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868761.894848:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868761.894949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939571968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868761.894957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787868761.895012:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939571968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868761.895165:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868761.895178:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939572096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868761.895226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868761.895462:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572096 00000100:00100000:0.0:1787868761.895467:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572096 00000100:00100000:0.0:1787868761.895499:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787868761.895507:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939572096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868761.895539:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868761.895582:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939572096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868761.895588:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787868761.895785:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939572096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787868762.211282:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868762.335086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868762.335148:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868762.335218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868762.335246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868762.335274:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868762.335368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500608 00000100:00100000:2.0:1787868762.335390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500608 00000100:00100000:2.0:1787868762.335465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500864 00000100:00100000:2.0:1787868762.335469:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500864 00000100:00100000:2.0:1787868762.335483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500480 00000100:00100000:2.0:1787868762.335486:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500480 00000100:00100000:2.0:1787868762.335497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500736 00000100:00100000:2.0:1787868762.335499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500736 00000100:00100000:2.0:1787868762.335515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:2.0:1787868762.335525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918500608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868762.335624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918500608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 100us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.335632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:2.0:1787868762.335654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:2.0:1787868762.335660:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868762.335685:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.335693:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:2.0:1787868762.335704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:2.0:1787868762.335710:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918500480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868762.335764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918500480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.335771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:2.0:1787868762.335784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00100000:2.0:1787868762.335790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868762.335825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918500736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.335832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00080000:0.0:1787868762.336192:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868762.336198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868762.336834:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500352 00000100:00100000:1.0:1787868762.336846:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500352 00000100:00100000:1.0:1787868762.336906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:1.0:1787868762.336916:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918500352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868762.337215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da83e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918500352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 300us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868762.337222:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:1.0:1787868762.894017:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868762.894095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918500992 00000100:00100000:2.0:1787868762.894105:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918500992 00000100:00100000:2.0:1787868762.894190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868762.894201:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:11099:x1874715918500992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868762.894223:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868762.894296:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894358:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894387:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894400:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868762.894445:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868762.894449:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868762.894615:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894641:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef59 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894657:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef59 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.894665:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3fd00) 00010000:00010000:2.0:1787868762.894668:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868762.894671:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868762.894892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+6:11099:x1874715918500992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 692us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.894899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1787868762.904938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868762.905193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501120 00000100:00100000:2.0:1787868762.905204:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501120 00000100:00100000:2.0:1787868762.905286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1787868762.905299:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+6:11100:x1874715918501120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868762.905323:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868762.905344:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef60 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905427:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905440:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905478:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905493:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905500:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905506:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905564:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905572:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905578:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868762.905622:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868762.905626:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868762.905644:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905655:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905661:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905677:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905683:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868762.905687:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905695:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905707:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3fd00) 00010000:00010000:2.0:1787868762.905710:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868762.905714:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905720:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905733:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905740:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905746:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905751:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868762.905753:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905768:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905777:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93dab5b3f800) 00010000:00010000:2.0:1787868762.905779:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868762.905782:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905788:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d33a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef60 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905835:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef60 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868762.905842:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93dab5b3ff00) 00010000:00010000:2.0:1787868762.905844:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868762.905846:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868762.905920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+7:11100:x1874715918501120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 625us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.905929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1787868762.908031:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868762.908131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501248 00000100:00100000:1.0:1787868762.908139:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501248 00000100:00100000:1.0:1787868762.908234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868762.908245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+7:11100:x1874715918501248:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787868762.908331:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:666039a7-1461-4e99-8c4e-10237114565a+7:11100:x1874715918501248:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868762.908338:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868762.911431:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868762.913756:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501504 00000100:00100000:3.0:1787868762.913773:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501504 00000100:00100000:3.0:1787868762.913885:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1787868762.913899:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+7:11100:x1874715918501504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868762.913922:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868762.913944:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d348 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef67 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914025:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914043:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914055:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914117:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914124:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914130:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914268:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ca00/0x2f11f4d3bde2d35d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914276:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ca00/0x2f11f4d3bde2d35d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.914297:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ca00/0x2f11f4d3bde2d35d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868762.914308:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787868762.916724:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916743:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916751:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916756:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868762.916761:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916768:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916786:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93dab5b3ff00) 00010000:00010000:3.0:1787868762.916790:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868762.916795:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916801:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d34f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916818:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916823:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916851:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916856:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868762.916859:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916865:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916873:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93da88316300) 00010000:00010000:3.0:1787868762.916876:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868762.916879:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.916885:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d356 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.919274:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d348 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef67 expref: 10 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.919852:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ca00/0x2f11f4d3bde2d35d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef67 expref: 9 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868762.919863:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:3.0:1787868762.919866:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868762.919869:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ca00, rc 0) 00000100:00100000:3.0:1787868762.919993:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+9:11100:x1874715918501504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 6094us (8571us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787868762.920026:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1787868762.931591:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868762.932540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501632 00000100:00100000:1.0:1787868762.932558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501632 00000100:00100000:1.0:1787868762.932655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1787868762.932669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+9:11100:x1874715918501632:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787868762.932837:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+9:11100:x1874715918501632:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 170us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868762.932846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1787868762.935294:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868762.935651:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501760 00000100:00100000:3.0:1787868762.935668:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501760 00000100:00100000:3.0:1787868762.935817:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1787868762.935832:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:11100:x1874715918501760:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787868762.942344:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6449us 00000100:00100000:2.0:1787868762.995446:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:11100:x1874715918501760:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 59599us (60148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868762.995491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000040:00080000:2.0:1787868763.043823:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787868763.051634:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868763.234384:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868764.258413:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868765.281504:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868765.819345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868765.819541:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918501888 00000100:00100000:2.0:1787868765.819551:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918501888 00000100:00100000:2.0:1787868765.819618:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1787868765.819628:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+9:11142:x1874715918501888:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868765.819650:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868765.819672:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef6e expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819734:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819748:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819760:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819774:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819780:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819787:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819823:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819838:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819845:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819851:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868765.819856:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819865:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819878:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3fd00) 00010000:00010000:2.0:1787868765.819881:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868765.819885:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819891:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819900:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819906:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819911:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819916:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868765.819924:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819931:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819939:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93dab5b3f800) 00010000:00010000:2.0:1787868765.819941:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868765.819944:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819948:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d379 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819977:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d36b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef6e expref: 10 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819986:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3fd00) 00010000:00010000:2.0:1787868765.819987:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868765.819990:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef6e expref: 10 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868765.819998:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868765.820056:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+9:11142:x1874715918501888:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 430us (721us total) trans 0 rc 301/301 00000100:00100000:2.0:1787868765.820062:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00080000:0.0:1787868765.820270:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868765.871369:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868765.871516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502144 00000100:00100000:0.0:1787868765.871527:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502144 00000100:00100000:0.0:1787868765.871578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1787868765.871587:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+9:11142:x1874715918502144:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:0.0:1787868765.871642:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868765.871669:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef59 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871688:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3fd00) 00010000:00010000:0.0:1787868765.871700:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868765.871763:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871788:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871818:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871833:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871840:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.871847:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872839:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872853:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872862:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868765.872881:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003470f75f reply state 00000000b247dbda transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872891:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872899:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868765.872902:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868765.872905:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787868765.872911:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787868765.872919:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872938:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872944:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872950:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868765.872954:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872961:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da83a5fe00) 00010000:00010000:0.0:1787868765.872974:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868765.872979:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.872985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d380 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868765.873002:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003470f75f reply state 00000000b247dbda transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.873010:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868765.873016:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93da83a5ff00) 00010000:00010000:0.0:1787868765.873018:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868765.873020:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787868765.873361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+10:11142:x1874715918502144:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 1770us (1999us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787868765.873377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1787868765.997150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868765.997386:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502272 00000100:00100000:3.0:1787868765.997397:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502272 00000100:00100000:3.0:1787868765.997466:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1787868765.997475:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+10:11150:x1874715918502272:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:3.0:1787868765.997500:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868765.997525:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef75 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997597:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997611:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997625:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868765.997671:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787868765.997676:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868765.997714:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997759:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef75 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997778:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef75 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868765.997786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:3.0:1787868765.997789:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868765.997793:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c200, rc 0) 00000100:00100000:3.0:1787868765.998033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+11:11150:x1874715918502272:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 557us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868765.998041:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1787868766.049353:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868766.053248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502400 00000100:00100000:2.0:1787868766.053263:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502400 00000100:00100000:1.0:1787868766.053610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1787868766.053622:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+11:11156:x1874715918502400:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1787868766.053654:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868766.053675:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053741:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053770:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053795:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053808:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053815:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053821:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053896:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053903:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.053910:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868766.053944:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787868766.053948:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868766.053993:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054005:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054021:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054027:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054033:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868766.054038:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054046:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054058:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:1.0:1787868766.054062:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868766.054067:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054072:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d3aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054103:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054109:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054115:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054120:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868766.054129:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054135:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054143:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93da83a5ff00) 00010000:00010000:1.0:1787868766.054146:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868766.054149:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054202:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d3b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054230:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef7c expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054244:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef7c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.054252:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868766.054255:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787868766.054257:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b400, rc 0) 00000100:00100000:1.0:1787868766.054349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+12:11156:x1874715918502400:12345-192.168.204.27@tcp:101:bash.0 Request processed in 730us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868766.054358:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:2.0:1787868766.060038:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.063735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502656 00000100:00100000:0.0:1787868766.063752:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502656 00000100:00100000:0.0:1787868766.065267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1787868766.065282:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+12:11156:x1874715918502656:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868766.065316:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868766.065339:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d3bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065519:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065547:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065562:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065569:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.065575:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868766.067224:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787868766.067856:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.067888:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.067899:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.067942:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.067949:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.067956:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068146:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868766.068151:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068499:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068512:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868766.068515:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868766.068520:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068526:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d3c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868766.068542:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006af6f234 reply state 0000000033430c57 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068561:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.068568:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:0.0:1787868766.068570:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868766.068573:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787868766.068618:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d3bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.069021:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.069031:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:0.0:1787868766.069034:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868766.069037:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287000, rc 0) 00000100:00100000:0.0:1787868766.069498:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+15:11156:x1874715918502656:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4218us (9466us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787868766.069507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1787868766.085528:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.085688:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502784 00000100:00100000:0.0:1787868766.085699:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502784 00000100:00100000:0.0:1787868766.085747:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1787868766.085756:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918502784:12345-192.168.204.27@tcp:8:bash.0 00010000:00080000:0.0:1787868766.085803:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1787868766.085837:0:8430:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d3e2 00002000:00100000:0.0:1787868766.085849:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 666039a7-1461-4e99-8c4e-10237114565a/ffff93daa072f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787868766.085868:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787868766.085955:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787868766.086030:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93daa072e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868766.086140:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918502784:12345-192.168.204.27@tcp:8:bash.0 Request processed in 383us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.086227:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1787868766.090944:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.091049:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918502912 00000100:00100000:0.0:1787868766.091060:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918502912 00000100:00100000:0.0:1787868766.091140:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1787868766.091151:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918502912:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868766.091204:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868766.091228:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef8a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868766.091268:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787868766.091287:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1787868766.091292:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868766.091312:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.091334:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.091348:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868766.091414:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:0:x1874715918502912:12345-192.168.204.27@tcp:101:bash.0 Request processed in 265us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.091421:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00080000:3.0:1787868766.092677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868766.100259:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.100385:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918503040 00000100:00100000:3.0:1787868766.100394:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918503040 00000100:00100000:3.0:1787868766.100459:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1787868766.100469:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:11156:x1874715918503040:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868766.100494:0:8962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868766.100729:0:8962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef91 expref: -99 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.100763:0:8962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.100772:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868766.100789:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868766.100794:0:8962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 8 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.100827:0:8962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.100842:0:8962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.100856:0:8962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8962:1874715939572224:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868766.101004:0:8962:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868766.111837:0:8962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8962:1874715939572224:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868766.111877:0:8962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 8 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.111900:0:8962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868766.111981:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+8:11156:x1874715918503040:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11512us (11740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.111993:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:2.0:1787868766.112642:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.114475:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918503168 00000100:00100000:3.0:1787868766.114488:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918503168 00010000:00010000:3.0:1787868766.114532:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.114595:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:3.0:1787868766.114619:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918503168:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868766.114635:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868766.114658:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868766.115562:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868766.115989:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.116025:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2d3e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef8a expref: 8 pid: 8431 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.116043:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00000040:00080000:0.0:1787868766.116310:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868766.116568:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868766.116579:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.116591:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.116636:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.116653:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1874715939572352:192.168.204.27@tcp:105: 00000100:00100000:3.0:1787868766.116761:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868766.127097:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1874715939572352:192.168.204.27@tcp:105: 00010000:00010000:3.0:1787868766.127150:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868766.127259:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918503168:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 12643us (15617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.127272:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1787868766.146046:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.148216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918503424 00000100:00100000:3.0:1787868766.148234:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918503424 00000100:00100000:3.0:1787868766.148336:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1787868766.148348:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+15:11156:x1874715918503424:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1787868766.148705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+16:11156:x1874715918503424:12345-192.168.204.27@tcp:35:bash.0 Request processed in 359us (2669us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787868766.148713:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1787868766.295711:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.295799:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918503680 00000100:00100000:3.0:1787868766.295809:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918503680 00000100:00100000:3.0:1787868766.295872:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787868766.295883:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+16:11166:x1874715918503680:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868766.295907:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868766.295943:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d3f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868766.296044:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787868766.296141:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d3f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef98 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.296195:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:3.0:1787868766.296199:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868766.296204:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d3f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef98 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.296252:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828cc00, rc 0) 00000100:00100000:3.0:1787868766.296330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+17:11166:x1874715918503680:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 448us (628us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787868766.296338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:2.0:1787868766.301315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.301611:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918503936 00000100:00100000:3.0:1787868766.301622:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918503936 00000100:00100000:3.0:1787868766.301727:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868766.301738:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+17:11166:x1874715918503936:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868766.301980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+18:11166:x1874715918503936:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 243us (685us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787868766.301987:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00010000:00010000:2.0:1787868766.309378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868766.475655:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.475876:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504064 00000100:00100000:3.0:1787868766.475886:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504064 00000100:00100000:3.0:1787868766.476276:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1787868766.476289:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:11172:x1874715918504064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868766.476326:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868766.476349:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fef9f expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476418:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476434:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476445:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868766.476499:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787868766.476503:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868766.476524:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476553:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef9f expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476574:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef9f expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.476583:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868766.476586:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868766.476590:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d000, rc 0) 00000100:00100000:3.0:1787868766.476947:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+19:11172:x1874715918504064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 660us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.476956:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1787868766.485354:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.485431:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504320 00000100:00100000:0.0:1787868766.485440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504320 00000100:00100000:0.0:1787868766.485497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1787868766.485506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+19:11172:x1874715918504320:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868766.485526:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868766.485546:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d413 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefa6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.485827:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d41a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.485842:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d41a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.485854:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d41a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868766.485864:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787868766.485966:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d413 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefa6 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.485984:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d41a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefa6 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.485993:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:0.0:1787868766.485996:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868766.486000:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868766.486070:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+21:11172:x1874715918504320:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 565us (727us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787868766.486088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1787868766.491083:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868766.493447:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504448 00000100:00100000:1.0:1787868766.493461:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504448 00000100:00100000:1.0:1787868766.493540:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868766.493551:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+21:2403:x1874715918504448:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868766.493568:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868766.493595:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d41a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefa6 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.493617:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:1.0:1787868766.493622:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868766.494375:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918504448:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 824us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868766.494384:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868766.496853:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868766.497115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504704 00000100:00100000:2.0:1787868766.497124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504704 00000100:00100000:2.0:1787868766.497216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1787868766.497226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+20:11172:x1874715918504704:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868766.497262:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868766.497284:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d428 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868766.497660:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868766.497675:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868766.497723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.497861:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572480 00000100:00100000:0.0:1787868766.497866:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572480 00000100:00100000:0.0:1787868766.497906:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787868766.497913:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939572480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868766.497927:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868766.497964:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939572480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.497970:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787868766.498011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868766.498325:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939572992:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498375:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939573504:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498527:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939574016:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498572:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787868766.498577:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939572608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868766.498594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498605:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939573120:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498661:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939573632:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498691:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939574144:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868766.498740:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574016 00000100:00100000:0.0:1787868766.498744:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574016 00000100:00100000:0.0:1787868766.498767:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573632 00000100:00100000:0.0:1787868766.498769:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573632 00000100:00100000:0.0:1787868766.498780:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574144 00000100:00100000:0.0:1787868766.498782:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574144 00000100:00100000:0.0:1787868766.498793:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787868766.498798:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939574016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498830:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939574016:12345-0@lo:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.498836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787868766.498847:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787868766.498852:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939573632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498871:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939573632:12345-0@lo:400:kworker.0 Request processed in 19us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.498876:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787868766.498883:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787868766.498888:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939574144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498918:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939574144:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.498923:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787868766.498947:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939573632:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498954:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939574144:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498961:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939574016:0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.498985:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573504 00000100:00100000:0.0:1787868766.498992:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573504 00000100:00100000:0.0:1787868766.499012:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573120 00000100:00100000:0.0:1787868766.499014:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573120 00000100:00100000:0.0:1787868766.499027:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787868766.499032:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939573504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.499061:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939573504:12345-0@lo:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.499067:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787868766.499077:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787868766.499082:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939573120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868766.499101:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939573120:12345-0@lo:400:kworker.0 Request processed in 20us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.499106:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787868766.499126:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939573120:0@lo:400:kworker.0 00010000:00080000:0.0:1787868766.499136:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f59a40 x1874715939573504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868766.499145:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939573504:0@lo:400:kworker.0 00010000:00010000:2.0:1787868766.499352:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868766.499368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868766.499379:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868766.499508:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:3.0:1787868766.499717:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939572736:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499783:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939573248:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499805:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499820:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939573760:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499859:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868766.499864:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939572864:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499885:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499915:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939573376:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499953:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939573888:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.499971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.499995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572736 00000100:00100000:3.0:1787868766.499999:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572736 00000100:00100000:3.0:1787868766.500024:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787868766.500029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939572736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.500061:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939572736:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.500067:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787868766.500088:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573760 00000100:00100000:3.0:1787868766.500091:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573760 00000100:00100000:3.0:1787868766.500105:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572864 00000100:00100000:3.0:1787868766.500107:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572864 00000100:00100000:3.0:1787868766.500117:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573376 00000100:00100000:3.0:1787868766.500119:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573376 00000100:00100000:3.0:1787868766.500128:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573888 00000100:00100000:3.0:1787868766.500130:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573888 00000100:00100000:3.0:1787868766.500141:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787868766.500146:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939573760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.500198:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939573760:12345-0@lo:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.500203:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787868766.500213:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787868766.500218:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939572864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.500236:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939572864:12345-0@lo:400:kworker.0 Request processed in 19us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.500248:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787868766.500259:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787868766.500265:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939573376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.500303:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939573376:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.500308:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787868766.500319:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787868766.500325:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939573888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.500351:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939573888:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.500357:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787868766.500383:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939572864:0@lo:400:kworker.0 00010000:00010000:2.0:1787868766.500526:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d428 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefad expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868766.500545:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefad expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868766.500564:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:2.0:1787868766.500568:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787868766.500572:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868766.500608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+22:11172:x1874715918504704:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3385us (3765us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787868766.500615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1787868766.500648:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572992 00000100:00100000:2.0:1787868766.500651:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572992 00000100:00100000:2.0:1787868766.500666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939572608 00000100:00100000:2.0:1787868766.500668:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939572608 00000100:00100000:2.0:1787868766.500675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939573248 00000100:00100000:2.0:1787868766.500677:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939573248 00000100:00100000:2.0:1787868766.500687:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787868766.500692:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939572992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868766.500730:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939572992:12345-0@lo:400:kworker.0 Request processed in 38us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868766.500736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787868766.500744:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787868766.500749:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939572608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868766.500766:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787868766.500790:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939572608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868766.500795:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787868766.500804:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787868766.500809:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939573248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868766.500837:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939573248:12345-0@lo:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868766.500843:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787868766.500874:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939572608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868766.500882:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939572992:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.501613:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939573376:0@lo:400:kworker.0 00010000:00080000:3.0:1787868766.501636:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f58f00 x1874715939573888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868766.501647:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939573888:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.501654:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939572736:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.501662:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939573248:0@lo:400:kworker.0 00000100:00100000:3.0:1787868766.501670:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939573760:0@lo:400:kworker.0 00000100:00080000:1.0:1787868766.501886:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868766.501891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868766.501893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868766.501896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868766.502046:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868766.506116:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868766.506224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.506730:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574272 00000100:00100000:3.0:1787868766.506739:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574272 00000100:00100000:3.0:1787868766.506796:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787868766.506820:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939574272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868766.506846:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868766.506903:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939574272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.506910:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787868766.507037:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868766.514622:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.514841:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504832 00000100:00100000:0.0:1787868766.514851:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504832 00000100:00100000:0.0:1787868766.514915:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1787868766.514925:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918504832:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:0.0:1787868766.514969:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.514992:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.515018:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868766.515022:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868766.515028:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.515065:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.515117:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 7 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868766.515134:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1874715939574400:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868766.515610:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18baf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868766.522800:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1874715939574400:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868766.522830:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.531337:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.531600:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918504960 00000100:00100000:0.0:1787868766.531612:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918504960 00002000:00100000:0.0:1787868766.531660:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93dab700a580 x1874715918504960/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:87/0 lens 504/0 e 0 to 0 dl 1787868777 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868766.531672:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab700a580 with x1874715918504960 ext(0->12) 00010000:00010000:0.0:1787868766.531680:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 8 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.531714:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 8 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868766.531722:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93dab700a580 00000100:00100000:0.0:1787868766.531759:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868766.531769:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918504960:12345-192.168.204.27@tcp:4:lfs.0 00000001:00100000:0.0:1787868766.540570:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000100:00100000:2.0:1787868766.544616:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918504960:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 12837us (13279us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787868766.544636:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:2.0:1787868766.544649:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93dab700a580 x1874715918504960/t4294967300(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:87/0 lens 504/448 e 0 to 0 dl 1787868777 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787868766.544658:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab700a580 with x1874715918504960 ext(0->12) 00010000:00010000:2.0:1787868766.544668:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868766.544688:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868766.544696:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93dab700a580 00000100:00100000:2.0:1787868766.553110:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.553224:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918505088 00000100:00100000:0.0:1787868766.553247:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918505088 00010000:00010000:0.0:1787868766.553313:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868766.553407:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1787868766.553767:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+9:2404:x1874715918505088:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868766.553785:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787868766.553805:0:7463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787868766.553808:0:7463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787868765 00002000:00010000:0.0:1787868766.553811:0:7463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787868766 00002000:00010000:0.0:1787868766.553814:0:7463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787868765 00002000:00010000:0.0:1787868766.553816:0:7463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787868766.553823:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.553837:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.553877:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d3f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef91 expref: 9 pid: 8962 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.553895:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868766.553900:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868766.553905:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.553914:0:7463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.553953:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868766.554013:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918505088:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 251us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.554021:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00010000:00010000:1.0:1787868766.554093:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554114:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554132:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554141:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554149:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554185:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868766.554189:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554198:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554212:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868766.554219:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067092920/0x2f11f4d3bde2d43d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868766.554304:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918504832:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 39381us (39693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868766.554312:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:1.0:1787868766.560922:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.561131:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918505344 00000100:00100000:3.0:1787868766.561142:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918505344 00000100:00100000:3.0:1787868766.561225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868766.561251:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+22:11172:x1874715918505344:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:3.0:1787868766.561325:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefad expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868766.561577:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787868766.561626:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787868766.561925:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787868766.561977:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.561992:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.562002:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.562034:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.562060:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 26 pid: 6513 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.562075:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939574528:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868766.562203:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868766.567462:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939574528:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868766.567496:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868766.571731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.572015:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918505472 00000100:00100000:0.0:1787868766.572025:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918505472 00010000:00010000:0.0:1787868766.572063:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 27 pid: 6513 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868766.572101:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:0.0:1787868766.572110:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+27:2404:x1874715918505472:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868766.572123:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868766.572130:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 27 pid: 6513 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572197:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 27 pid: 6513 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572222:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d3d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef83 expref: 27 pid: 6513 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572248:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:0.0:1787868766.572254:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572264:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572272:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.572306:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868766.572351:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+26:2404:x1874715918505472:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 241us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.572358:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00010000:00010000:3.0:1787868766.572957:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.572966:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868766.573071:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787868766.573220:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787868766.573328:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939574656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787868766.573378:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.573423:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868766.573527:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574656 00000100:00100000:2.0:1787868766.573533:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574656 00000100:00100000:2.0:1787868766.573574:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787868766.573583:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939574656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787868766.573667:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939574656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868766.573683:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787868766.575679:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939574656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787868766.575887:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787868766.575956:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939574784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787868766.576010:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868766.576049:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9154dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868766.576274:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574784 00000100:00100000:2.0:1787868766.576280:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574784 00000100:00100000:2.0:1787868766.576335:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787868766.576344:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939574784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787868766.576490:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1874715939574784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (478us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787868766.576497:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787868766.577139:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939574784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787868766.577225:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787868766.577277:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577287:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577305:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577312:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868766.577317:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577325:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577341:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:3.0:1787868766.577344:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787868766.577349:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.577355:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d444 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787868766.577773:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787868766.577845:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787868766.577857:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390703701037ns, next at 391703698602ns, rc = 0 00000001:00080000:3.0:1787868766.577864:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1787868766.577889:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da83a5fd00) 00010000:00010000:3.0:1787868766.577892:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787868766.577906:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d42f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefad expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868766.578195:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+29:11172:x1874715918505344:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 16959us (17280us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787868766.578205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000020:00080000:3.0:1787868766.578210:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787868766.587028:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.587106:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918505600 00000100:00100000:3.0:1787868766.587116:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918505600 00000100:00100000:3.0:1787868766.587207:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:3.0:1787868766.587219:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+29:11172:x1874715918505600:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868766.587572:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868766.587599:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d44b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefb4 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.587671:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d44b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefb4 expref: 30 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.587685:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d44b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefb4 expref: 30 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.587703:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868766.587706:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868766.587710:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c600, rc 0) 00000100:00100000:3.0:1787868766.587775:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+30:11172:x1874715918505600:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 558us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868766.587782:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:0.0:1787868766.590962:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.591050:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918505856 00000100:00100000:3.0:1787868766.591073:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918505856 00000100:00100000:3.0:1787868766.591128:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868766.591137:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e36c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+30:11172:x1874715918505856:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868766.591623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e36c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+31:11172:x1874715918505856:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 485us (669us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787868766.591632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1787868766.752819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.753069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918506112 00000100:00100000:0.0:1787868766.753080:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918506112 00000100:00100000:0.0:1787868766.753145:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1787868766.753235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+31:11183:x1874715918506112:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868766.753263:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868766.753282:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868766.753604:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787868766.753711:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d452 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefbb expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.753726:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:0.0:1787868766.753729:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868766.753735:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefbb expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.753748:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287000, rc 0) 00000100:00100000:0.0:1787868766.754035:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+32:11183:x1874715918506112:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 880us (1225us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787868766.754043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1787868766.767772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.767868:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918506240 00000100:00100000:0.0:1787868766.767879:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918506240 00000100:00100000:0.0:1787868766.767943:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1787868766.767963:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+32:11183:x1874715918506240:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1787868766.768042:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768059:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768071:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768083:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768105:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768111:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768224:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768232:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768239:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868766.768294:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768306:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768313:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768320:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768325:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868766.768330:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768337:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768357:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868766.768360:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868766.768364:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768370:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d460 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768764:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768772:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768778:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768784:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868766.768787:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768792:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768802:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:0.0:1787868766.768805:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868766.768808:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768812:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d467 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768833:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768838:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768844:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768849:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868766.768851:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768856:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768863:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868766.768866:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868766.768869:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.768874:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d46e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868766.768960:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+32:11183:x1874715918506240:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 998us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.768969:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1787868766.772903:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.773245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918506496 00000100:00100000:3.0:1787868766.773256:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918506496 00000100:00100000:3.0:1787868766.773324:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787868766.773336:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+32:11183:x1874715918506496:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868766.773919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+33:11183:x1874715918506496:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 584us (1025us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787868766.773929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1787868766.878317:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.878548:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918506752 00000100:00100000:3.0:1787868766.878558:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918506752 00000100:00100000:3.0:1787868766.878621:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787868766.878633:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+33:11186:x1874715918506752:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868766.878660:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868766.878681:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d475 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefc2 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878757:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878772:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878786:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878811:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878820:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878827:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878946:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878955:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.878963:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868766.878975:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787868766.879061:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879069:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879076:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879081:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868766.879086:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879103:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879117:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868766.879121:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868766.879126:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879132:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d47c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879150:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879199:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879205:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879210:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868766.879213:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879219:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879237:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:3.0:1787868766.879240:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868766.879243:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879259:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879306:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d475 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 36 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879321:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 35 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868766.879328:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868766.879330:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868766.879332:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d400, rc 0) 00000100:00100000:3.0:1787868766.879890:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+35:11186:x1874715918506752:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 768us (1092us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787868766.879900:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:2.0:1787868766.885309:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868766.885418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918506880 00000100:00100000:0.0:1787868766.885428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918506880 00000100:00100000:0.0:1787868766.885492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1787868766.885517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+35:11186:x1874715918506880:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1787868766.885587:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885603:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885615:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885649:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885655:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885661:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885666:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868766.885669:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885676:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885686:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868766.885689:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868766.885692:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868766.885698:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d498 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868766.885791:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+35:11186:x1874715918506880:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 275us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868766.885799:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1787868766.891634:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868766.892010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918507136 00000100:00100000:3.0:1787868766.892021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918507136 00000100:00100000:3.0:1787868766.892080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787868766.892091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+35:11186:x1874715918507136:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868766.892639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+36:11186:x1874715918507136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 547us (1012us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787868766.892647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787868767.009894:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868767.009920:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939574912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868767.010002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868767.010247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939574912 00000100:00100000:1.0:1787868767.010255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939574912 00000100:00100000:1.0:1787868767.010315:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787868767.010324:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939574912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868767.010354:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868767.010410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939574912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868767.010416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787868767.010628:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939574912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868767.011245:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939575040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868767.011296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868767.011342:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868767.011350:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868767.011375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868767.011469:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939575040 00000100:00100000:0.0:1787868767.011475:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939575040 00000100:00100000:0.0:1787868767.011516:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939575168 00000100:00100000:0.0:1787868767.011520:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939575168 00000100:00100000:3.0:1787868767.011525:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787868767.011623:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939575040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868767.011646:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868767.011687:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939575040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868767.018331:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939575040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868767.019054:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787868767.019073:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939575168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868767.019100:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868767.019206:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939575168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (7830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868767.019214:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787868767.019822:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868767.024958:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787868767.280079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868767.280196:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918507392 00000100:00100000:2.0:1787868767.280205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918507392 00000100:00100000:2.0:1787868767.280296:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1787868767.280312:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+36:11217:x1874715918507392:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1787868767.280337:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868767.280356:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d49f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefc9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.280486:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.280501:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.280513:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868767.280525:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787868767.280652:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d49f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc9 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.280671:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc9 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.280680:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868767.280683:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868767.280686:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871800, rc 0) 00000100:00100000:2.0:1787868767.280768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+38:11217:x1874715918507392:12345-192.168.204.27@tcp:101:cat.0 Request processed in 462us (698us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787868767.280775:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00080000:1.0:1787868767.281003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868767.285835:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.285983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918507648 00000100:00100000:0.0:1787868767.285993:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918507648 00000100:00100000:0.0:1787868767.286049:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1787868767.286059:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+38:11217:x1874715918507648:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:0.0:1787868767.286358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+39:11217:x1874715918507648:12345-192.168.204.27@tcp:35:cat.0 Request processed in 300us (531us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787868767.286365:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1787868767.290315:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.290402:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918507776 00000100:00100000:3.0:1787868767.290411:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918507776 00000100:00100000:3.0:1787868767.290478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1787868767.290488:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+39:2403:x1874715918507776:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868767.290504:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868767.290530:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d4a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc9 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.290548:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868767.290553:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868767.290604:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+38:2403:x1874715918507776:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.290612:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00010000:00010000:3.0:1787868767.329399:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868767.376744:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.376886:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508032 00000100:00100000:0.0:1787868767.376896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508032 00000100:00100000:0.0:1787868767.376957:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1787868767.376968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+38:11223:x1874715918508032:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1787868767.376993:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868767.376996:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787868767.377039:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d40c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef9f expref: 38 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377057:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868767.377062:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868767.377075:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefd0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377268:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377299:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 38 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377308:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377340:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 38 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.377353:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 38 pid: 10190 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868767.377366:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939575296:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868767.377457:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868767.380969:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.381105:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508160 00000100:00100000:3.0:1787868767.381114:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508160 00010000:00010000:3.0:1787868767.381170:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 39 pid: 10190 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868767.381215:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1787868767.381234:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+39:2404:x1874715918508160:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868767.381265:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868767.381281:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 39 pid: 10190 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.381296:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 39 pid: 10190 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.381316:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868767.381321:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.381330:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.381338:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.381361:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868767.381562:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+39:2404:x1874715918508160:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 321us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.381571:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00010000:00010000:0.0:1787868767.381719:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d48a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefc2 expref: 38 pid: 10190 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868767.381736:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939575296:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868767.381765:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.381773:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.381779:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868767.381795:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787868767.381934:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.381949:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.381957:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868767.381959:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787868767.381961:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287000, rc 0) 00000100:00100000:0.0:1787868767.381986:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+38:11223:x1874715918508032:12345-192.168.204.27@tcp:101:dd.0 Request processed in 5021us (5252us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787868767.381993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1787868767.394392:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868767.394466:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508288 00000100:00100000:1.0:1787868767.394488:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508288 00000100:00100000:1.0:1787868767.394546:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1787868767.394565:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+38:11223:x1874715918508288:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:1.0:1787868767.394590:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868767.394609:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d4c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefd7 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394644:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394657:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394669:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394778:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d4c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 40 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394800:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 39 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.394810:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868767.394813:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787868767.394816:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a600, rc 0) 00000100:00100000:1.0:1787868767.395003:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+39:11223:x1874715918508288:12345-192.168.204.27@tcp:101:dd.0 Request processed in 448us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868767.395011:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1787868767.406920:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.407065:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508544 00000100:00100000:0.0:1787868767.407073:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508544 00000100:00100000:0.0:1787868767.407128:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1787868767.407138:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+39:11223:x1874715918508544:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:0.0:1787868767.407383:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.407407:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.407419:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787868767.407478:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787868767.407509:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8a985a1 reply state 00000000911f919a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.407521:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.407528:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868767.407531:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868767.407534:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868767.407778:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+42:11223:x1874715918508544:12345-192.168.204.27@tcp:36:dd.0 Request processed in 640us (866us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787868767.407786:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:0.0:1787868767.407791:0:10190:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787868767.449747:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.449784:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.449814:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.449856:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868767.449886:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508928 00000100:00100000:0.0:1787868767.449894:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508928 00000100:00100000:0.0:1787868767.449939:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:0.0:1787868767.449948:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918508928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868767.450015:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918508928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868767.450036:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:0.0:1787868767.450079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.450366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508800 00000100:00100000:3.0:1787868767.450371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508800 00000100:00100000:3.0:1787868767.450405:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509056 00000100:00100000:3.0:1787868767.450408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509056 00000100:00100000:3.0:1787868767.450429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509184 00000100:00100000:3.0:1787868767.450432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509184 00000100:00100000:3.0:1787868767.450448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:3.0:1787868767.450455:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918508800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868767.450499:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918508800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 45us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.450506:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:3.0:1787868767.450519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 316 00000100:00100000:3.0:1787868767.450525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918509056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868767.450548:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918509056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.450565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 316 00000100:00100000:3.0:1787868767.450578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:3.0:1787868767.450584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918509184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868767.450619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918509184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.450625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:1.0:1787868767.451215:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918508672 00000100:00100000:1.0:1787868767.451221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918508672 00000100:00100000:1.0:1787868767.451258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00100000:1.0:1787868767.451265:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918508672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868767.451318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918508672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868767.451326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00080000:1.0:1787868767.451353:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868767.451357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868767.813881:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.814597:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509312 00000100:00100000:3.0:1787868767.814610:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509312 00000100:00100000:3.0:1787868767.814696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1787868767.814708:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+42:11237:x1874715918509312:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:3.0:1787868767.815063:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868767.815086:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d4de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefde expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815261:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815290:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815317:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815331:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815339:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815346:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815416:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815428:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815438:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815471:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.815485:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 43 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868767.815499:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882bb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939575424:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868767.815633:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868767.820010:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882bb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939575424:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868767.820056:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868767.820558:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.820651:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509568 00000100:00100000:3.0:1787868767.820663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509568 00000100:00100000:3.0:1787868767.820762:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787868767.820780:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+44:6176:x1874715918509568:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787868767.821324:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+45:6176:x1874715918509568:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 549us (767us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787868767.821334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1787868767.827045:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868767.827725:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509696 00000100:00100000:3.0:1787868767.827745:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509696 00010000:00010000:3.0:1787868767.827803:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 45 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868767.827863:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1787868767.827875:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+45:2403:x1874715918509696:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868767.827895:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868767.827903:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 45 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.827920:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 45 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.827951:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d4bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd0 expref: 45 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.827997:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868767.828004:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.828016:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.828025:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868767.828071:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868767.828151:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+44:2403:x1874715918509696:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 278us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868767.828197:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00010000:00010000:2.0:1787868767.828500:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828509:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868767.828589:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787868767.828595:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868767.828652:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828669:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828679:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828686:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828693:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828699:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868767.828704:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828712:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828724:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868767.828728:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868767.828733:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828740:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2d4e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828765:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828772:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828778:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828785:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868767.828788:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828795:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828808:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:2.0:1787868767.828811:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868767.828815:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d4ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828869:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d4de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefde expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828888:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefde expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868767.828908:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868767.828910:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868767.828913:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d400, rc 0) 00000100:00100000:2.0:1787868767.828965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+44:11237:x1874715918509312:12345-192.168.204.27@tcp:101:stat.0 Request processed in 14259us (15093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868767.828974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1787868767.916038:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868767.916121:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918509952 00000100:00100000:1.0:1787868767.916133:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918509952 00000100:00100000:1.0:1787868767.916221:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1787868767.916231:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+43:11243:x1874715918509952:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:1.0:1787868767.916310:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868767.916339:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d4f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefde expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.916358:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868767.916363:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868767.916552:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.916567:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.916576:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868767.916615:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787868767.916650:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd82b61e reply state 000000002f61186c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.916662:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.916668:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868767.916671:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868767.916673:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868767.916998:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+45:11243:x1874715918509952:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 768us (968us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787868767.917016:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000020:00080000:1.0:1787868767.917021:0:10190:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787868767.920219:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:3.0:1787868767.920261:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787868767.920293:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93daa18bad80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787868767.920298:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013f200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d9882e5780 00000020:00080000:3.0:1787868767.920301:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93da9313a200 00000100:00100000:3.0:1787868767.920467:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939575552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787868767.920533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868767.921945:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939575552 00000100:00100000:1.0:1787868767.921956:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939575552 00000100:00100000:1.0:1787868767.922028:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868767.922038:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939575552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787868767.922069:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787868767.922103:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a90b65d, atime: 0x6a90b65e, ctime: 0x6a90b65d, blocks: 0x8 00010000:00010000:1.0:1787868767.922111:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922127:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787868767.922132:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868767.922138:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922177:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922205:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922213:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922229:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787868767.922387:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3636:x1874715939575552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 351us (1854us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787868767.922395:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787868767.922415:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868767.922421:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922429:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868767.922433:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922443:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922459:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922465:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa1173f/0x2f11f4d3bde2d501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868767.922488:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868767.922489:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868767.922491:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787868767.922522:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7f79e00/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787868767.922527:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939575552:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787868767.922706:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922715:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922721:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922726:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868767.922730:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922737:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922748:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93da83a5ff00) 00010000:00010000:0.0:1787868767.922750:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868767.922754:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922760:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d387 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922784:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922790:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922796:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922801:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868767.922803:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922809:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922815:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868767.922818:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868767.922820:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922826:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d38e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922836:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922842:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922848:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922856:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868767.922859:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922865:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922872:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:0.0:1787868767.922874:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868767.922876:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922882:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d3cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922893:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922899:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922904:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922909:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868767.922912:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922918:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922932:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868767.922934:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868767.922937:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922942:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d4d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922950:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922956:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922962:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922967:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868767.922970:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922976:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922982:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868767.922984:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868767.922986:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868767.922992:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d4fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787868767.923333:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787868767.923484:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787868768.069213:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.071980:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918510080 00000100:00100000:2.0:1787868768.072001:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918510080 00000100:00100000:2.0:1787868768.072096:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1787868768.072107:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+11:11257:x1874715918510080:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1787868768.072135:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868768.072174:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefe5 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072243:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072270:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072284:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072672:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072700:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072708:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072855:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072865:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072873:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868768.072917:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787868768.072922:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868768.072942:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072956:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072965:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072972:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072979:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.072995:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.073000:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073086:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073100:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868768.073103:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.073108:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073115:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d50f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073130:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073136:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073142:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073148:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.073150:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073198:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073217:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3f800) 00010000:00010000:2.0:1787868768.073220:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.073223:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073229:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073278:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 13 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073293:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 12 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.073371:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.073373:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868768.073376:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870c00, rc 0) 00000100:00100000:2.0:1787868768.073447:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+12:11257:x1874715918510080:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1342us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868768.073456:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1787868768.203739:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.203935:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918510336 00000100:00100000:2.0:1787868768.203946:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918510336 00000100:00100000:2.0:1787868768.204011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1787868768.204023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+12:11267:x1874715918510336:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868768.204045:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868768.204075:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963fefec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868768.204242:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787868768.204937:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d524 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefec expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.204959:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868768.204962:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868768.204966:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefec expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.204987:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868768.205140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+13:11267:x1874715918510336:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1118us (1411us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1787868768.205148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1787868768.220874:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868768.221562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918510592 00000100:00100000:3.0:1787868768.221574:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918510592 00000100:00100000:3.0:1787868768.221649:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787868768.221660:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+13:11267:x1874715918510592:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868768.221895:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+14:11267:x1874715918510592:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 237us (1031us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787868768.221916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1787868768.306741:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868768.306942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918510848 00000100:00100000:0.0:1787868768.306953:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918510848 00000100:00100000:0.0:1787868768.307031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868768.307043:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:11273:x1874715918510848:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868768.307107:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868768.307137:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d532 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963feff3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.307324:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.307346:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.307356:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.307400:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.307423:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 15 pid: 13805 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868768.307454:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939575680:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868768.307583:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868768.311843:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939575680:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868768.311883:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868768.319570:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868768.319766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918510976 00000100:00100000:3.0:1787868768.319786:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918510976 00010000:00010000:3.0:1787868768.319851:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 16 pid: 13805 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868768.319909:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787868768.319923:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+16:2404:x1874715918510976:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868768.319955:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868768.319964:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 16 pid: 13805 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.319981:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 16 pid: 13805 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.320010:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d51d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefe5 expref: 16 pid: 13805 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.320030:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868768.320036:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.320047:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.320056:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868768.320443:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868768.320521:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+15:2404:x1874715918510976:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 600us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868768.320531:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00010000:00010000:2.0:1787868768.324194:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.324225:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868768.324273:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787868768.324496:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2d532 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.324547:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.324556:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.324560:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787868768.324564:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:2.0:1787868768.324665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+15:11273:x1874715918510848:12345-192.168.204.27@tcp:101:bash.0 Request processed in 17623us (17933us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787868768.324676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1787868768.331527:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.331638:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918511232 00000100:00100000:2.0:1787868768.331652:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918511232 00000100:00100000:2.0:1787868768.331765:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1787868768.331778:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+15:11273:x1874715918511232:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:2.0:1787868768.332098:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.332121:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.332135:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787868768.332460:0:13805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1787868768.332493:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d9944e1 reply state 0000000000bd6e7b transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.332510:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.332537:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.332541:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868768.332546:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868768.332876:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:11273:x1874715918511232:12345-192.168.204.27@tcp:36:bash.0 Request processed in 1097us (1722us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787868768.332885:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000020:00080000:2.0:1787868768.332892:0:13805:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787868768.341290:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.341655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918511360 00000100:00100000:2.0:1787868768.341670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918511360 00000100:00100000:2.0:1787868768.341744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1787868768.341757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:11273:x1874715918511360:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868768.341800:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868768.341831:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d54e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963feffa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.342023:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.342042:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.342052:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.342098:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.342112:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 19 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868768.342149:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939575808:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868768.342323:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868768.345687:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939575808:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868768.345729:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868768.347782:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.348134:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918511488 00000100:00100000:2.0:1787868768.348148:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918511488 00010000:00010000:2.0:1787868768.348236:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 20 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868768.348295:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1787868768.348308:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918511488:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868768.348327:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868768.348334:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 20 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348350:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 20 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348390:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d539 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963feff3 expref: 20 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348412:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.348419:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348449:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348458:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.348502:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868768.348640:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+19:2403:x1874715918511488:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 334us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868768.348650:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00010000:00010000:0.0:1787868768.348853:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.348862:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868768.348950:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787868768.348956:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868768.348982:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.349024:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d54e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feffa expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.349042:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feffa expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.349049:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868768.349052:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868768.349055:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:0.0:1787868768.349089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+18:11273:x1874715918511360:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7335us (7832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868768.349098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00010000:00010000:2.0:1787868768.353963:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868768.355734:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868768.355815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918511744 00000100:00100000:3.0:1787868768.355828:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918511744 00000100:00100000:3.0:1787868768.355901:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:3.0:1787868768.355915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e35c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+18:11273:x1874715918511744:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1787868768.356835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e35c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+19:11273:x1874715918511744:12345-192.168.204.27@tcp:35:bash.0 Request processed in 917us (1110us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787868768.356847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1787868768.454578:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.454711:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512000 00000100:00100000:2.0:1787868768.454726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512000 00000100:00100000:2.0:1787868768.454805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:2.0:1787868768.454818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+19:11283:x1874715918512000:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868768.454851:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868768.454877:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff001 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868768.455081:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787868768.455507:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d55c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff001 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.455525:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868768.455528:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868768.455534:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2d55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff001 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.455574:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868768.455661:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+20:11283:x1874715918512000:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 845us (1097us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787868768.455670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:0.0:1787868768.460814:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.461423:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512128 00000100:00100000:2.0:1787868768.461438:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512128 00000100:00100000:2.0:1787868768.461567:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:2.0:1787868768.461580:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+20:11283:x1874715918512128:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868768.461689:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461711:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461726:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461745:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461753:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461760:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461859:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461891:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461899:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868768.461978:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.461995:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462002:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462008:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462015:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.462020:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462028:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462041:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868768.462044:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.462050:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462056:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2d56a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462079:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462085:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462091:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462096:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.462098:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462105:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462114:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3f800) 00010000:00010000:2.0:1787868768.462116:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.462119:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462125:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2d571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462144:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462150:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462186:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462209:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.462213:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462220:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462229:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.462232:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.462235:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.462240:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d578 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868768.462652:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+20:11283:x1874715918512128:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 1069us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868768.462662:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1787868768.467511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868768.467672:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512384 00000100:00100000:3.0:1787868768.467685:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512384 00000100:00100000:3.0:1787868768.467817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868768.467830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+20:11283:x1874715918512384:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868768.468671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+21:11283:x1874715918512384:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 837us (1170us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787868768.468682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1787868768.547094:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868768.547211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512640 00000100:00100000:0.0:1787868768.547225:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512640 00000100:00100000:0.0:1787868768.547322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1787868768.547334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+21:11286:x1874715918512640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868768.547368:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868768.547395:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d57f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff008 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547490:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547524:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547541:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547548:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547688:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547697:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547705:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868768.547727:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787868768.547818:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547827:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547835:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547843:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868768.547848:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547856:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547869:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868768.547872:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868768.547878:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547886:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d586 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547903:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547909:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547925:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547930:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868768.547934:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547940:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547946:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da83a5f100) 00010000:00010000:0.0:1787868768.547949:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868768.547952:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.547959:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d58d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.548010:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d57f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff008 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.548026:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff008 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.548034:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868768.548036:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868768.548039:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868768.548127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+23:11286:x1874715918512640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 797us (1048us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787868768.548145:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1787868768.553695:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868768.556116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868768.556284:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512768 00000100:00100000:1.0:1787868768.556297:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512768 00000100:00100000:1.0:1787868768.556375:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1787868768.556387:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+23:11286:x1874715918512768:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1787868768.556475:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556497:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556512:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556556:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556563:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556587:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556595:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868768.556600:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556609:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556623:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868768.556626:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868768.556631:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.556638:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868768.556727:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+23:11286:x1874715918512768:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 342us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868768.556735:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:3.0:1787868768.559487:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868768.560665:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918513152 00000100:00100000:1.0:1787868768.560681:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918513152 00000100:00100000:1.0:1787868768.560748:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1787868768.560759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+23:11286:x1874715918513152:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1787868768.561066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+24:11286:x1874715918513152:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 309us (1596us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787868768.561075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1787868768.565678:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918512896 00000100:00100000:0.0:1787868768.565701:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918512896 00000100:00100000:0.0:1787868768.565814:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868768.565827:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+24:2404:x1874715918512896:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868768.565849:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868768.565885:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2d594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff008 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.565911:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868768.565917:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868768.565998:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+23:2404:x1874715918512896:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 173us (9898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868768.566007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1787868768.845301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868768.845415:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918513408 00000100:00100000:1.0:1787868768.845434:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918513408 00000100:00100000:1.0:1787868768.845527:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:1.0:1787868768.845541:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+23:11304:x1874715918513408:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:1.0:1787868768.845574:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868768.845603:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff00f expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.845760:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d5b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.845911:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.845938:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868768.845953:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787868768.846100:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d5a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff00f expref: 26 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.846138:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff00f expref: 25 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.846150:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868768.846318:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787868768.846325:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1aa00, rc 0) 00000100:00100000:1.0:1787868768.846578:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+25:11304:x1874715918513408:12345-192.168.204.27@tcp:101:cat.0 Request processed in 1038us (1293us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787868768.846609:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1787868768.893600:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868768.893858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918513536 00000100:00100000:0.0:1787868768.893871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918513536 00000100:00100000:0.0:1787868768.893957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1787868768.893969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:11305:x1874715918513536:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868768.894002:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868768.894028:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff016 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.894121:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.894139:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.894218:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868768.894768:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787868768.894776:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868768.894990:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.895036:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2d5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff016 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.895064:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff016 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.895074:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868768.895077:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868768.895082:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868768.895506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+26:11305:x1874715918513536:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1535us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868768.895516:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1787868768.904532:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868768.904691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918513920 00000100:00100000:1.0:1787868768.904704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918513920 00000100:00100000:1.0:1787868768.904784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1787868768.904797:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+26:11305:x1874715918513920:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1787868768.906516:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+27:11305:x1874715918513920:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 1708us (1984us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787868768.906532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787868768.917730:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868768.918036:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514048 00000100:00100000:0.0:1787868768.918050:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514048 00000100:00100000:0.0:1787868768.918142:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1787868768.918193:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+27:11305:x1874715918514048:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:0.0:1787868768.918217:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787868768.918271:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2d555 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feffa expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.918320:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d5b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff00f expref: 26 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.918360:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d44b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefb4 expref: 25 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868768.918376:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868768.918382:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868768.918459:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+24:11305:x1874715918514048:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 306us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868768.918468:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1787868768.923528:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868768.924152:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514176 00000100:00100000:1.0:1787868768.924353:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514176 00000100:00100000:1.0:1787868768.924541:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:1.0:1787868768.924553:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+24:11305:x1874715918514176:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:1.0:1787868768.924697:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.924717:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868768.924730:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868768.925004:0:10190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868768.925150:0:10190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787868768.925292:0:10190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787868768.925392:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+24:11305:x1874715918514176:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 841us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868768.925401:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:1.0:1787868768.958004:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868768.958535:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514304 00000100:00100000:2.0:1787868768.958546:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514304 00000100:00100000:2.0:1787868768.958622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1787868768.958632:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+24:11307:x1874715918514304:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868768.958656:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868768.958679:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff01d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958781:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958796:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958820:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958835:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958842:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958850:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958922:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958931:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.958939:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868768.958979:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787868768.958984:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868768.959002:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959045:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959051:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959058:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959064:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.959068:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959075:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959087:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868768.959091:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.959095:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959116:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959122:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959135:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959140:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868768.959142:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959149:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959231:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3f800) 00010000:00010000:2.0:1787868768.959234:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868768.959237:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959254:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959313:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868768.959321:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868768.959323:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868768.959325:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031600, rc 0) 00000100:00100000:2.0:1787868768.959391:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+25:11307:x1874715918514304:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 760us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868768.959406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000040:00080000:3.0:1787868769.189000:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868769.189010:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868769.189049:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787868769.189057:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868769.189247:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939575936:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868769.189349:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868769.197010:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939575936:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787868769.211768:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.220425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514432 00000100:00100000:0.0:1787868769.220440:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514432 00000100:00100000:0.0:1787868769.220523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:0.0:1787868769.220536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:11318:x1874715918514432:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787868769.220568:0:6514:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787868769.220711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:11318:x1874715918514432:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 178us (8953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.220719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00080000:2.0:1787868769.221007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868769.228288:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.228431:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514560 00000100:00100000:2.0:1787868769.228441:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514560 00000100:00100000:2.0:1787868769.228503:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:2.0:1787868769.228516:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+25:11318:x1874715918514560:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787868769.228588:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228606:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228618:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228687:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228696:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228703:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228731:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228741:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228747:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868769.228816:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787868769.228821:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868769.228835:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228849:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228855:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228862:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228869:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868769.228873:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228881:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228893:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:2.0:1787868769.228896:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868769.228900:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228907:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d5ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228921:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228937:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228943:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228948:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868769.228950:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228956:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228964:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff93dab5b3f800) 00010000:00010000:2.0:1787868769.228967:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868769.228969:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228974:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d5f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228989:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.228995:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.229000:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.229005:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868769.229322:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.229330:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.229339:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868769.229342:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868769.229344:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.229350:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d5fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868769.229435:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+25:11318:x1874715918514560:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 920us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.229443:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1787868769.233363:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.233444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514816 00000100:00100000:3.0:1787868769.233454:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514816 00000100:00100000:3.0:1787868769.233515:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:3.0:1787868769.233526:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+25:11318:x1874715918514816:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868769.233548:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868769.233569:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d604 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff024 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233700:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233715:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233727:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868769.233740:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787868769.233832:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233839:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233846:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233869:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868769.233874:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233881:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233902:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868769.233905:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868769.233910:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233916:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d60b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233964:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d604 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff024 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233974:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:3.0:1787868769.233976:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868769.233979:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d604 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff024 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.233988:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d000, rc 0) 00000100:00100000:3.0:1787868769.234064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918514816:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 540us (711us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787868769.234072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1787868769.255453:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.255602:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918514944 00000100:00100000:3.0:1787868769.255633:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918514944 00000100:00100000:3.0:1787868769.255716:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1787868769.255728:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918514944:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787868769.255780:0:13805:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787868769.256147:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918514944:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 418us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868769.256210:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:1.0:1787868769.271985:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.275434:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918515200 00000100:00100000:2.0:1787868769.275449:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918515200 00000100:00100000:2.0:1787868769.275530:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:2.0:1787868769.275541:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918515200:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868769.275563:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868769.275566:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787868769.275593:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d5c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff016 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.275614:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868769.275619:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868769.275635:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d619 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff02b expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787868769.276334:0:10190:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787868769.276478:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.276492:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.276503:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.276557:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d619 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff02b expref: 28 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.276573:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d620 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff02b expref: 27 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.276580:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f800) 00010000:00010000:2.0:1787868769.276582:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868769.276585:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031000, rc 0) 00000100:00100000:2.0:1787868769.276667:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+27:11318:x1874715918515200:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1127us (4692us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787868769.276686:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:2.0:1787868769.294813:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.295443:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918515456 00000100:00100000:0.0:1787868769.295454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918515456 00000100:00100000:0.0:1787868769.295510:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:0.0:1787868769.295519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:11318:x1874715918515456:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787868769.295586:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868769.295611:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d620 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff02b expref: 27 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295631:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f800) 00010000:00010000:0.0:1787868769.295643:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868769.295663:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295677:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295687:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295701:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295708:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295715:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295758:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295765:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295771:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295783:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868769.295787:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295795:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295803:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868769.295806:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868769.295809:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295815:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d62e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295825:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295831:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295837:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295842:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868769.295845:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295851:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295868:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x210918ed (ffff93da83a5f100) 00010000:00010000:0.0:1787868769.295871:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868769.295874:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.295932:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2d635 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x210918ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.296004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918515456:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 486us (1201us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787868769.296011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:1.0:1787868769.308487:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.311278:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918515584 00000100:00100000:2.0:1787868769.311292:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918515584 00000100:00100000:2.0:1787868769.311367:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:2.0:1787868769.311542:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+26:11318:x1874715918515584:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868769.311572:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868769.311595:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d63c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff032 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311633:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311646:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311657:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311757:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d63c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 28 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311777:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.311785:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:2.0:1787868769.311788:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868769.311791:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030800, rc 0) 00000100:00100000:2.0:1787868769.311864:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+27:11318:x1874715918515584:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 327us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868769.322460:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.322494:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918515840 00000100:00100000:3.0:1787868769.322504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918515840 00000100:00100000:3.0:1787868769.322561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1787868769.322571:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+28:11318:x1874715918515840:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868769.322704:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.322721:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.322734:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868769.322902:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787868769.322916:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393448759627ns, next at 394448753134ns, rc = 0 00000100:00100000:2.0:1787868769.322947:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00000004:00010000:3.0:1787868769.322963:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000892a425f reply state 0000000018c7d1a5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.322975:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.322983:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:3.0:1787868769.322993:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787868769.322997:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868769.323103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+29:11318:x1874715918515840:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 533us (653us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787868769.323110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:0.0:1787868769.330883:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.331057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918515968 00000100:00100000:2.0:1787868769.331066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918515968 00000100:00100000:2.0:1787868769.331135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1787868769.331145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+29:11318:x1874715918515968:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868769.331207:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868769.331226:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff039 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.331296:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.331312:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.331330:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:2.0:1787868769.331333:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868769.331336:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031a00, rc 0) 00000100:00100000:2.0:1787868769.331395:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+30:11318:x1874715918515968:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 251us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.331401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1787868769.334134:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.334342:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516096 00000100:00100000:0.0:1787868769.334361:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516096 00000100:00100000:0.0:1787868769.334409:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1787868769.334418:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874715918516096:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787868769.334454:0:8429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:0.0:1787868769.334486:0:8429:0:(genops.c:1385:class_connect()) connect: client 666039a7-1461-4e99-8c4e-10237114565a, cookie 0x2f11f4d3bde2d658 00002000:00100000:0.0:1787868769.334499:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 666039a7-1461-4e99-8c4e-10237114565a/ffff93daa072c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787868769.334516:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787868769.334591:0:8429:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787868769.334622:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93daa072f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868769.334693:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2402:x1874715918516096:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 Request processed in 274us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.334702:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1787868769.339100:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868769.339233:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516224 00000100:00100000:1.0:1787868769.339255:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516224 00000100:00100000:1.0:1787868769.339349:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1787868769.339359:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:0:x1874715918516224:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787868769.339525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787868769.351914:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1787868769.351932:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000100:00100000:0.0:1787868769.352953:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:0:x1874715918516224:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 13588us (13855us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787868769.352978:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1787868769.362769:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.364005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516480 00000100:00100000:3.0:1787868769.364027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516480 00000100:00100000:3.0:1787868769.364124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1787868769.364138:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+30:11318:x1874715918516480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787868769.364788:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+31:11318:x1874715918516480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 650us (2026us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787868769.364797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1787868769.369278:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.369850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516736 00000100:00100000:3.0:1787868769.369866:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516736 00000100:00100000:3.0:1787868769.369957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:3.0:1787868769.369971:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+31:11318:x1874715918516736:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787868769.370293:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+31:11318:x1874715918516736:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 324us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868769.370303:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00010000:00010000:3.0:1787868769.380569:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868769.384841:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.387598:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516864 00000100:00100000:0.0:1787868769.387619:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516864 00000100:00100000:0.0:1787868769.387717:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:0.0:1787868769.387733:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+31:11318:x1874715918516864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868769.387765:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868769.387794:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d65f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff040 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.387904:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.387924:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.387939:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868769.388009:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868769.388041:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.388074:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d65f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff040 expref: 33 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.388095:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff040 expref: 32 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.388106:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:0.0:1787868769.388129:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787868769.388135:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868769.393717:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+32:11318:x1874715918516864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 5969us (8871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.393738:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:2.0:1787868769.412090:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.412883:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918516992 00000100:00100000:0.0:1787868769.412897:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918516992 00000100:00100000:0.0:1787868769.412978:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1787868769.412991:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918516992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868769.413017:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868769.413047:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff047 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868769.413084:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b661, blocks: 0x0 00010000:00010000:0.0:1787868769.413111:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1787868769.413116:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868769.413129:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.413176:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.413197:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286400, rc 0) 00000100:00100000:0.0:1787868769.413302:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918516992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 313us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.413311:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1787868769.419730:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.420524:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517248 00000100:00100000:2.0:1787868769.420540:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517248 00000100:00100000:2.0:1787868769.420627:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:2.0:1787868769.420641:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+32:11318:x1874715918517248:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787868769.420797:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+32:11318:x1874715918517248:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 158us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.420806:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:1.0:1787868769.428309:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.428639:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517376 00000100:00100000:3.0:1787868769.428654:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517376 00000100:00100000:3.0:1787868769.428731:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1787868769.428745:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+6:11318:x1874715918517376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868769.428786:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868769.428827:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff04e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.428869:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.428880:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868769.428885:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868769.428891:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.428937:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.428954:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 7 pid: 8429 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.428971:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939576064:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868769.429108:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebb900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868769.444999:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.445250:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517504 00000100:00100000:0.0:1787868769.445263:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517504 00010000:00010000:0.0:1787868769.445320:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 8 pid: 8429 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.445371:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1787868769.445382:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918517504:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868769.445400:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868769.445429:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 8 pid: 8429 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.445446:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 8 pid: 8429 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.445588:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868769.445594:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868769.445605:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.445617:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.445664:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.445680:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874715939576192:192.168.204.27@tcp:105: 00000100:00100000:0.0:1787868769.445814:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787868769.446023:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d66d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff047 expref: 8 pid: 8429 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.446040:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939576064:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868769.446077:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.446101:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868769.446140:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:11318:x1874715918517376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 17398us (17850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868769.446149:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787868769.449666:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874715939576192:192.168.204.27@tcp:105: 00010000:00010000:0.0:1787868769.449705:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868769.449777:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918517504:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 4396us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.449791:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1787868769.453952:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.457494:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517632 00000100:00100000:0.0:1787868769.457518:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517632 00002000:00100000:0.0:1787868769.457598:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93dab7f6c000 x1874715918517632/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:90/0 lens 504/0 e 0 to 0 dl 1787868780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868769.457612:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7f6c000 with x1874715918517632 ext(0->8) 00002000:00010000:0.0:1787868769.457618:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93dab7f6c000 00000100:00100000:0.0:1787868769.457649:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868769.457660:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918517632:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787868769.464202:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918517632:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 6531us (10254us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787868769.464217:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:0.0:1787868769.464231:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93dab7f6c000 x1874715918517632/t4294967303(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:90/0 lens 504/448 e 0 to 0 dl 1787868780 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868769.464253:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7f6c000 with x1874715918517632 ext(0->8) 00002000:00010000:0.0:1787868769.464260:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93dab7f6c000 00000100:00100000:2.0:1787868769.468841:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.468960:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517760 00000100:00100000:3.0:1787868769.468971:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517760 00000100:00100000:3.0:1787868769.469060:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:3.0:1787868769.469071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+32:11318:x1874715918517760:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787868769.471923:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787868769.471939:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787868769.471981:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787868769.472024:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787868769.472036:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1787868769.472129:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472142:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472151:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472186:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868769.472192:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472199:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472226:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:1.0:1787868769.472229:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868769.472898:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472909:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2d547 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472930:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472936:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472941:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472945:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868769.472948:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472954:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472963:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:1.0:1787868769.472966:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787868769.472969:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.472975:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d64a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868769.473129:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868769.473148:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939576320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787868769.473253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868769.473453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:11318:x1874715918517760:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 4381us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868769.473463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:2.0:1787868769.473643:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939576320 00000100:00100000:2.0:1787868769.473651:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939576320 00000100:00100000:2.0:1787868769.473717:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868769.473726:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939576320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787868769.473854:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787868769.473858:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787868769 00002000:00010000:2.0:1787868769.473860:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787868769.473862:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787868769 -> 1787868769 00002000:00010000:2.0:1787868769.473865:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787868769.473903:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939576320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (651us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787868769.473910:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787868769.474323:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787868769.474357:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7f6ed00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787868769.474364:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939576320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787868769.484265:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868769.484374:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918517888 00000100:00100000:1.0:1787868769.484401:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918517888 00000100:00100000:1.0:1787868769.484486:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1787868769.484498:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918517888:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787868769.497841:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787868769.497857:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787868769.497975:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918517888:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 13473us (13732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.497988:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1787868769.500439:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.500633:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518144 00000100:00100000:3.0:1787868769.500646:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518144 00000100:00100000:3.0:1787868769.500740:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1787868769.500752:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+14:11318:x1874715918518144:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868769.500815:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868769.500849:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2d666 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff040 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.500869:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:3.0:1787868769.500875:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868769.500912:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.500928:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.500952:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868769.501078:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f87b2a9c reply state 00000000e78dfb92 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.501091:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.501098:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:3.0:1787868769.501101:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868769.501104:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868769.501324:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+15:11318:x1874715918518144:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 573us (896us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787868769.501454:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:2.0:1787868769.507152:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.507268:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518272 00000100:00100000:0.0:1787868769.507286:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518272 00000100:00100000:0.0:1787868769.507343:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1787868769.507354:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918518272:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787868769.507532:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787868769.507536:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787868769 -> 1787868768 00002000:00010000:0.0:1787868769.507538:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787868766 00002000:00010000:0.0:1787868769.507541:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787868769 -> 1787868768 00002000:00010000:0.0:1787868769.507543:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787868769.507605:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918518272:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 253us (462us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787868769.507613:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1787868769.517007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.517094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518528 00000100:00100000:0.0:1787868769.517106:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518528 00000100:00100000:0.0:1787868769.517198:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:0.0:1787868769.517209:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+15:11318:x1874715918518528:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787868769.517290:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.517306:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.517315:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.517356:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.517370:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 15 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.517394:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939576448:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868769.517477:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868769.520351:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868769.521605:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518656 00000100:00100000:1.0:1787868769.521617:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518656 00010000:00010000:1.0:1787868769.521656:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 16 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868769.521691:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1787868769.521700:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+16:2403:x1874715918518656:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868769.521716:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868769.521723:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 16 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.521738:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 16 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.521771:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:1.0:1787868769.521777:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.521787:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.521796:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.521816:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868769.521891:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+16:2403:x1874715918518656:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 191us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868769.521900:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00010000:00010000:0.0:1787868769.528710:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d643 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff032 expref: 15 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.528740:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939576448:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868769.528767:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529261:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529270:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529320:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529327:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529334:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529341:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868769.529345:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529366:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529393:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:0.0:1787868769.529397:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787868769.529401:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.529407:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2d682 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.529674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+14:11318:x1874715918518528:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 12456us (12664us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787868769.529686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:3.0:1787868769.535142:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868769.535306:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518784 00000100:00100000:1.0:1787868769.535318:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518784 00000100:00100000:1.0:1787868769.535376:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1787868769.535397:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918518784:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787868769.535446:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.535465:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.535473:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868769.535477:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787868769.535482:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.535534:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.535561:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 7 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868769.535575:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939576576:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868769.535655:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787868769.537557:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939576576:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868769.537584:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.539985:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.540893:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918518912 00000100:00100000:2.0:1787868769.540904:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918518912 00010000:00010000:2.0:1787868769.540964:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868769.541014:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1787868769.541024:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918518912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868769.541039:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868769.541062:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.541077:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.541103:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42eafc5/0x2f11f4d3bde2d674 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff04e expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.541120:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868769.541125:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868769.541131:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.541142:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.541424:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868769.541481:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918518912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 458us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.541489:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00010000:00010000:1.0:1787868769.541490:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541500:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541521:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541530:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541547:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541553:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868769.541557:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541566:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541581:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868769.541589:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4efa206/0x2f11f4d3bde2d689 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868769.541636:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918518784:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 6252us (6505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868769.541644:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1787868769.545839:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.548579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918519168 00000100:00100000:3.0:1787868769.548593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918519168 00000100:00100000:3.0:1787868769.548661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:3.0:1787868769.548671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:11318:x1874715918519168:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787868769.548751:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.548771:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.548792:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.548833:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.548848:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 14 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.548865:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939576704:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868769.549033:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868769.554114:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.554208:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918519296 00000100:00100000:0.0:1787868769.554220:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918519296 00010000:00010000:0.0:1787868769.554271:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 15 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.554305:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1787868769.554315:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+15:2404:x1874715918519296:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868769.554330:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868769.554336:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 15 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.554348:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 15 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.554377:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:0.0:1787868769.554391:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.554401:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.554408:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.554427:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868769.554480:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+15:2404:x1874715918519296:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 165us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.554488:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00010000:00010000:3.0:1787868769.557457:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d4d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963fefd7 expref: 14 pid: 13805 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.557488:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939576704:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868769.557512:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.557913:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.557922:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.558117:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.558133:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.558142:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.558919:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.558940:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 14 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868769.558955:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939576832:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868769.559059:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da85fabcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868769.564047:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868769.564112:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918519424 00000100:00100000:0.0:1787868769.564123:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918519424 00010000:00010000:0.0:1787868769.564267:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868769.564307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1787868769.564317:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+15:2405:x1874715918519424:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868769.564342:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868769.564349:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.564363:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.564408:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:0.0:1787868769.564413:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.564422:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.564429:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868769.564449:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868769.564502:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+15:2405:x1874715918519424:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.564510:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00010000:00010000:3.0:1787868769.567815:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d651 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff039 expref: 14 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.567841:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939576832:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868769.567868:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.567879:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.567905:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868769.568016:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787868769.568460:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787868769.568508:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787868769.568586:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939576960:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787868769.568651:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868769.568679:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daafdd6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868769.568904:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939576960 00000100:00100000:0.0:1787868769.568912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939576960 00000100:00100000:0.0:1787868769.568965:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787868769.568976:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1874715939576960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787868769.569058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1874715939576960:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868769.569065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787868769.569311:0:6512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787868769.569317:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7f6ed00, transno 4294967304 00000100:00100000:3.0:1787868769.569484:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939576960:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787868769.569614:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787868769.569828:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939577088:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787868769.569864:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868769.569934:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868769.579982:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939577088 00000100:00100000:0.0:1787868769.579999:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939577088 00000100:00100000:2.0:1787868769.580298:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787868769.580310:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1874715939577088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787868769.580531:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1874715939577088:12345-0@lo:1000:mdt00_000.0 Request processed in 223us (10665us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787868769.580539:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787868769.580713:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939577088:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787868769.580771:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580782:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580790:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580796:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868769.580801:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580817:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580834:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:3.0:1787868769.580837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868769.580843:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580850:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d697 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580887:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580893:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580899:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580905:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868769.580908:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580914:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580923:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868769.580925:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868769.580928:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580943:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d5cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580972:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580986:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.580994:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.581027:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.581042:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 17 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.581055:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939577216:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868769.581132:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868769.596263:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868769.596298:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918519552 00000100:00100000:2.0:1787868769.596308:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918519552 00010000:00010000:2.0:1787868769.596350:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 18 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868769.596386:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1787868769.596396:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+18:2404:x1874715918519552:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868769.596410:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868769.596417:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 18 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.596431:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 18 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.596455:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:2.0:1787868769.596461:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.596471:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.596479:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.596499:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868769.596551:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+18:2404:x1874715918519552:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 157us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868769.596559:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:3.0:1787868769.597964:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d5e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff01d expref: 17 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.597986:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939577216:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868769.598012:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598022:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598040:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598052:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598058:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598066:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598071:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868769.598076:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598099:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868769.598101:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868769.598105:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598111:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d69e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598122:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598129:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598140:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598145:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868769.598148:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598171:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598399:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93da88316600) 00010000:00010000:3.0:1787868769.598401:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868769.598404:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.598410:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d690 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868769.598570:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+16:11318:x1874715918519168:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 49899us (52740us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787868769.598581:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00000020:00080000:3.0:1787868769.598587:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787868769.600087:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868769.600097:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868769.600116:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787868769.600125:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868769.603784:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868769.603830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918519808 00000100:00100000:3.0:1787868769.603840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918519808 00000100:00100000:3.0:1787868769.604199:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1787868769.604211:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+16:11318:x1874715918519808:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787868769.604501:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787868769.604539:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787868769.604584:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604601:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604614:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604624:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604630:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604637:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868769.604657:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787868769.604746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+18:11318:x1874715918519808:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 537us (971us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787868769.604754:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000020:00080000:3.0:1787868769.604759:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787868769.606479:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868769.606491:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.606503:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828de00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868769.606506:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.606516:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.606533:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:2.0:1787868769.606536:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787868769.606540:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.606546:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d6a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868769.606558:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868769.606560:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868769.606561:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787868770.076142:0:14207:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787868770.076152:0:14207:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787868770.076193:0:14207:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787868770.076201:0:14207:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787868770.287683:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.287768:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918520064 00000100:00100000:1.0:1787868770.287784:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918520064 00000100:00100000:1.0:1787868770.287847:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:1.0:1787868770.287857:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:11328:x1874715918520064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868770.287882:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868770.287903:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff055 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.288021:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d6b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.288035:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.288050:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868770.288060:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787868770.288190:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff055 expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.288212:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff055 expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.288231:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868770.288234:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787868770.288238:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a800, rc 0) 00000100:00100000:1.0:1787868770.288291:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+20:11328:x1874715918520064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 436us (619us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787868770.288298:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:0.0:1787868770.295838:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.298809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918520192 00000100:00100000:2.0:1787868770.298825:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918520192 00000100:00100000:2.0:1787868770.298902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1787868770.298914:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+20:11328:x1874715918520192:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868770.299004:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299021:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299053:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299068:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299075:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299080:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299263:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299272:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299280:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868770.299324:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299337:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299344:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299352:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299368:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.299373:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299381:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299395:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868770.299398:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.299402:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299408:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d6c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299422:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299428:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299434:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299438:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.299441:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299447:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299461:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3f800) 00010000:00010000:2.0:1787868770.299463:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.299466:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299472:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d6c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299488:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299493:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299499:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299503:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.299506:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299521:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.299529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.299531:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.300444:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.300457:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868770.300976:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+20:11328:x1874715918520192:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 2059us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.300987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:1.0:1787868770.381778:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.381868:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918520448 00000100:00100000:3.0:1787868770.381879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918520448 00000100:00100000:3.0:1787868770.381950:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:3.0:1787868770.381961:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+20:11331:x1874715918520448:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868770.381982:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868770.382003:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d6d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.382097:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.382111:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.382124:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.382139:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.382146:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.384314:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385417:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385449:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868770.385460:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787868770.385540:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385548:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385554:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385559:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.385562:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385569:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385582:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868770.385597:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.385602:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385608:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d6dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385621:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385627:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385632:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385637:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.385639:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385644:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385651:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93da82a4d600) 00010000:00010000:2.0:1787868770.385653:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.385656:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385661:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d6e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d6d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385735:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.385743:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.385745:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868770.385747:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031a00, rc 0) 00000100:00100000:2.0:1787868770.385848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:11331:x1874715918520448:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3888us (4080us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787868770.385857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:0.0:1787868770.390763:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.390855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918520576 00000100:00100000:1.0:1787868770.390866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918520576 00000100:00100000:1.0:1787868770.390929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:1.0:1787868770.390939:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+22:11331:x1874715918520576:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1787868770.391008:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391024:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391036:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391072:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391078:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391085:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391091:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868770.391095:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391101:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391113:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:1.0:1787868770.391117:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868770.391135:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.391142:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d6f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868770.391437:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+22:11331:x1874715918520576:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 498us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868770.391444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:0.0:1787868770.394342:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.394408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918520832 00000100:00100000:3.0:1787868770.394416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918520832 00000100:00100000:3.0:1787868770.394463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868770.394473:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+22:11331:x1874715918520832:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868770.394683:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+23:11331:x1874715918520832:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 210us (348us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787868770.394690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:2.0:1787868770.401469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868770.435011:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.435196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521088 00000100:00100000:2.0:1787868770.435207:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521088 00000100:00100000:2.0:1787868770.435283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:2.0:1787868770.435296:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+23:10857:x1874715918521088:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868770.435511:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868770.435595:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d700 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.435709:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.435726:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.435736:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.435767:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.435781:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 24 pid: 6512 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868770.435794:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939577344:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868770.435883:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868770.438593:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939577344:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868770.438640:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868770.440760:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868770.440951:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521216 00000100:00100000:0.0:1787868770.440960:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521216 00010000:00010000:0.0:1787868770.440998:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 25 pid: 6512 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868770.441036:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1787868770.441044:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+25:2404:x1874715918521216:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868770.441058:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868770.441065:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 25 pid: 6512 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441079:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 25 pid: 6512 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441102:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d6eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff05c expref: 25 pid: 6512 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441119:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:0.0:1787868770.441124:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441133:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441140:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.441246:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868770.441292:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+24:2404:x1874715918521216:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 248us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868770.441300:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00010000:00010000:2.0:1787868770.441585:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.441593:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868770.441613:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787868770.441745:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d700 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.441768:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.441789:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.441792:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787868770.441795:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ae00, rc 0) 00000100:00100000:2.0:1787868770.441835:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:10857:x1874715918521088:12345-192.168.204.27@tcp:101:bash.0 Request processed in 6542us (6833us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787868770.441842:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1787868770.447014:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.447281:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521344 00000100:00100000:2.0:1787868770.447291:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521344 00000100:00100000:2.0:1787868770.447351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:2.0:1787868770.447361:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+24:10857:x1874715918521344:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868770.447384:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868770.447404:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d715 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff06a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447438:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d71c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447451:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d71c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447461:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d71c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447573:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d715 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff06a expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447589:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d71c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff06a expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.447605:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.447608:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868770.447612:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031e00, rc 0) 00000100:00100000:2.0:1787868770.447681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+25:10857:x1874715918521344:12345-192.168.204.27@tcp:101:bash.0 Request processed in 321us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.447688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:0.0:1787868770.450932:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.451021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521600 00000100:00100000:1.0:1787868770.451032:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521600 00000100:00100000:1.0:1787868770.451087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:1.0:1787868770.451099:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:10857:x1874715918521600:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1787868770.451369:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.451386:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.451397:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868770.451432:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1787868770.451449:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044de3a53 reply state 0000000003b9083d transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.451462:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.451469:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:1.0:1787868770.451472:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868770.451475:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787868770.451504:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1787868770.451601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+29:10857:x1874715918521600:12345-192.168.204.27@tcp:36:bash.0 Request processed in 504us (678us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787868770.451609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000020:00080000:1.0:1787868770.451614:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787868770.454002:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.454076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521728 00000100:00100000:2.0:1787868770.454087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521728 00000100:00100000:2.0:1787868770.454149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:2.0:1787868770.454203:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+29:10857:x1874715918521728:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868770.454236:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868770.454255:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d72a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.454312:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d72a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff071 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.454338:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d72a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff071 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.454355:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.454359:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868770.454362:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031000, rc 0) 00000100:00100000:2.0:1787868770.454409:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+30:10857:x1874715918521728:12345-192.168.204.27@tcp:101:bash.0 Request processed in 210us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.454431:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:0.0:1787868770.457965:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.458045:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521856 00000100:00100000:2.0:1787868770.458055:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521856 00000100:00100000:2.0:1787868770.458110:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1787868770.458121:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+6:10857:x1874715918521856:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868770.458137:0:8962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868770.458310:0:8962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff078 expref: -99 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868770.458811:0:8962:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a90b660, atime: 0x6a90b65e, ctime: 0x6a90b660, blocks: 0x8 00010000:00010000:1.0:1787868770.458838:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1787868770.458843:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868770.458854:0:8962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.458873:0:8962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.458886:0:8962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030800, rc 0) 00000100:00100000:1.0:1787868770.458993:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:10857:x1874715918521856:12345-192.168.204.27@tcp:101:bash.0 Request processed in 874us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868770.459001:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1787868770.461684:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.461787:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918521984 00000100:00100000:2.0:1787868770.461797:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918521984 00002000:00010000:2.0:1787868770.461835:0:8434:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787868770.461839:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7f5ad00 with x1874715918521984 ext(0->18446744073709551615) 00002000:00010000:2.0:1787868770.461851:0:8434:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93dab7f5ad00. 00000100:00100000:2.0:1787868770.461915:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1787868770.461924:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918521984:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:1.0:1787868770.462540:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787868770.462545:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787868768 -> 1787868770 00002000:00010000:1.0:1787868770.462547:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787868766 -> 1787868766 00002000:00010000:1.0:1787868770.462550:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787868768 -> 1787868770 00002000:00010000:1.0:1787868770.462552:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787868770.462656:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918521984:12345-192.168.204.27@tcp:10:bash.0 Request processed in 729us (978us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787868770.462669:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00010000:1.0:1787868770.462673:0:8434:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1787868770.462675:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7f5ad00 with x1874715918521984 ext(0->18446744073709551615) 00002000:00010000:1.0:1787868770.462681:0:8434:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93dab7f5ad00. 00000100:00100000:0.0:1787868770.545372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.545569:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918522112 00000100:00100000:2.0:1787868770.545580:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918522112 00000100:00100000:2.0:1787868770.545651:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:2.0:1787868770.545665:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+30:11345:x1874715918522112:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868770.545765:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545784:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545798:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545831:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545839:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545846:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545918:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545926:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545932:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868770.545979:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545991:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.545998:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546005:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546012:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.546016:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546031:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546044:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868770.546047:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.546052:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546059:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d738 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546073:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546078:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546083:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546088:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.546090:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546095:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546102:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3fa00) 00010000:00010000:2.0:1787868770.546105:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.546107:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546123:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d73f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546138:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546143:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546148:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546223:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.546227:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546234:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546242:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.546244:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.546247:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.546253:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d746 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868770.546595:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+30:11345:x1874715918522112:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 932us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.546605:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:0.0:1787868770.608445:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.608539:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918522368 00000100:00100000:1.0:1787868770.608563:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918522368 00000100:00100000:1.0:1787868770.608633:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:1.0:1787868770.608644:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+30:11348:x1874715918522368:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868770.608670:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868770.608695:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d74d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff07f expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608785:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608800:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608812:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608829:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608836:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608843:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608979:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d762 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608991:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.608999:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868770.609018:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787868770.609115:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609123:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609130:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609138:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868770.609142:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609151:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609245:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868770.609248:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868770.609253:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609260:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2d754 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609283:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609289:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609305:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609311:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868770.609314:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609320:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609329:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:1.0:1787868770.609331:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868770.609334:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609339:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070a00/0x2f11f4d3bde2d75b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609384:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2d74d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff07f expref: 33 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609399:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff07f expref: 32 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.609406:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:1.0:1787868770.609408:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787868770.609411:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0800, rc 0) 00000100:00100000:1.0:1787868770.609482:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+32:11348:x1874715918522368:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 840us (1047us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787868770.609501:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:2.0:1787868770.616305:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.616361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918522496 00000100:00100000:3.0:1787868770.616372:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918522496 00000100:00100000:3.0:1787868770.616431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:3.0:1787868770.616443:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+32:11348:x1874715918522496:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1787868770.616518:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.616535:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.616545:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.616579:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.616594:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 32 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868770.616607:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939577472:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868770.616704:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da98975480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868770.619366:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939577472:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868770.619405:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868770.620910:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.620980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918522752 00000100:00100000:3.0:1787868770.620988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918522752 00000100:00100000:3.0:1787868770.621037:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787868770.621044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+33:6176:x1874715918522752:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787868770.621395:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+34:6176:x1874715918522752:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 350us (488us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787868770.621408:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868770.633550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.633659:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918522880 00000100:00100000:2.0:1787868770.633670:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918522880 00010000:00010000:2.0:1787868770.633709:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868770.633754:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1787868770.633764:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+34:2403:x1874715918522880:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868770.633782:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868770.633789:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633802:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633825:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2d707 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff063 expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633848:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.633853:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633863:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633870:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.633922:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868770.633980:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+33:2403:x1874715918522880:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 217us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.633988:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00010000:00010000:3.0:1787868770.634208:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634225:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634264:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634272:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634279:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634285:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868770.634289:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634297:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634307:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:3.0:1787868770.634526:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868770.634530:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.634536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2d770 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868770.634689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+32:11348:x1874715918522496:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 18247us (18392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.634698:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:0.0:1787868770.640283:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.640530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918523136 00000100:00100000:1.0:1787868770.640540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918523136 00000100:00100000:1.0:1787868770.640598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1787868770.640611:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+32:11348:x1874715918523136:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1787868770.640839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+33:11348:x1874715918523136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 231us (566us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787868770.640848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1787868770.720351:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.720603:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918523392 00000100:00100000:2.0:1787868770.720613:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918523392 00000100:00100000:2.0:1787868770.720681:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:2.0:1787868770.720693:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+33:11359:x1874715918523392:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1787868770.720720:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868770.720742:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d777 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff086 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720817:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720832:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720844:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720877:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720885:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.720909:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721207:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d78c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721228:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d78c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721236:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d78c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868770.721245:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787868770.721345:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721354:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721361:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721367:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.721371:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721389:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721401:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868770.721404:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.721416:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721422:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d77e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721437:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721442:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721447:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721452:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.721454:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721459:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721466:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dab5b3fa00) 00010000:00010000:2.0:1787868770.721468:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.721471:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721476:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d785 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721515:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d777 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff086 expref: 36 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721541:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d78c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff086 expref: 35 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.721549:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868770.721551:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868770.721553:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031a00, rc 0) 00000100:00100000:2.0:1787868770.721623:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+35:11359:x1874715918523392:12345-192.168.204.27@tcp:101:cat.0 Request processed in 933us (1283us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787868770.721631:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:0.0:1787868770.735921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.736194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918523648 00000100:00100000:1.0:1787868770.736206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918523648 00000100:00100000:1.0:1787868770.736287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1787868770.736299:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+35:11359:x1874715918523648:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:1.0:1787868770.736616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+36:11359:x1874715918523648:12345-192.168.204.27@tcp:35:cat.0 Request processed in 317us (703us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787868770.736624:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787868770.767375:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868770.767521:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918523904 00000100:00100000:1.0:1787868770.767531:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918523904 00000100:00100000:1.0:1787868770.767594:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:1.0:1787868770.767606:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+36:11360:x1874715918523904:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:1.0:1787868770.767670:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787868770.767698:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2d72a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff071 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767724:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d78c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff086 expref: 35 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767760:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff07f expref: 34 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767779:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d71c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff06a expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767789:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:1.0:1787868770.767794:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868770.767814:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767827:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767837:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767851:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767858:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767866:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767962:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767972:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.767990:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868770.768503:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787868770.768515:0:13805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394894358186ns, next at 395894355303ns, rc = 0 00010000:00010000:1.0:1787868770.768561:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768571:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768579:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768586:0:13805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768592:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768599:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768619:0:13805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787868770.768643:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768650:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768657:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768671:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868770.768677:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768685:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768697:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:1.0:1787868770.768700:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787868770.768704:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768710:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768730:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768736:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768743:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768748:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868770.768751:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768757:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768777:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868770.768779:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868770.768783:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768789:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d79a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787868770.768799:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4e87083 reply state 00000000ee24efd7 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768810:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.768816:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:1.0:1787868770.768818:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868770.768821:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787868770.769020:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868770.769027:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.769034:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868770.769036:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.769042:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.769052:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:3.0:1787868770.769054:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787868770.769057:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.769063:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2d7af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.769075:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868770.769076:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868770.769078:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868770.769626:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+34:11360:x1874715918523904:12345-192.168.204.27@tcp:36:rm.0 Request processed in 2016us (2253us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787868770.769637:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:0.0:1787868770.835297:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.837768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524160 00000100:00100000:2.0:1787868770.837786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524160 00000100:00100000:2.0:1787868770.837925:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:2.0:1787868770.837936:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+34:11366:x1874715918524160:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868770.837961:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868770.837982:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d7b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff08d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838083:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838108:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838118:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838140:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838178:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787868770.838535:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787868770.838683:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838692:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838700:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838732:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838739:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838744:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838750:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868770.838754:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838762:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838787:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868770.838790:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868770.838795:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838801:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d7bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868770.838815:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016a64f6d reply state 00000000c9284ed2 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838826:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838832:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:2.0:1787868770.838834:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868770.838837:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787868770.838862:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d7b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838876:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.838883:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:2.0:1787868770.838885:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868770.838887:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031e00, rc 0) 00000100:00100000:2.0:1787868770.838968:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+37:11366:x1874715918524160:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1034us (3681us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787868770.838976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:0.0:1787868770.844018:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.847027:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524288 00000100:00100000:3.0:1787868770.847043:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524288 00000100:00100000:3.0:1787868770.847192:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1787868770.847218:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918524288:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868770.847236:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868770.847258:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff094 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787868770.847297:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868770.847329:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1787868770.847342:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868770.847353:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.847372:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868770.847386:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d200, rc 0) 00000100:00100000:3.0:1787868770.847445:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918524288:12345-192.168.204.27@tcp:101:bash.0 Request processed in 244us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868770.847453:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00080000:1.0:1787868770.850064:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868770.857290:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868770.857472:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524416 00000100:00100000:0.0:1787868770.857483:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524416 00000100:00100000:0.0:1787868770.857534:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:0.0:1787868770.857558:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+8:11366:x1874715918524416:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868770.857578:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868770.857596:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff09b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.857631:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.857660:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868770.857665:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868770.857671:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.857720:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868770.857735:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868770.857749:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7ffe580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1874715939577600:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868770.857848:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868770.863868:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868770.864108:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7ffe580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1874715939577600:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868770.864144:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868770.864222:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286400, rc 0) 00000100:00100000:2.0:1787868770.864280:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+9:11366:x1874715918524416:12345-192.168.204.27@tcp:101:bash.0 Request processed in 6737us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868770.864289:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1787868770.865756:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524544 00000100:00100000:1.0:1787868770.865769:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524544 00010000:00010000:1.0:1787868770.865814:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868770.865852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1787868770.865862:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+9:2404:x1874715918524544:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868770.865892:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868770.865912:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.865927:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.865949:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f02ed8/0x2f11f4d3bde2d7d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff094 expref: 9 pid: 8430 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.865964:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868770.865968:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868770.865976:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.865985:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868770.866019:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868770.866034:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874715939577728:192.168.204.27@tcp:105: 00000100:00100000:1.0:1787868770.866653:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868770.878003:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868770.878431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524800 00000100:00100000:3.0:1787868770.878442:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524800 00000100:00100000:3.0:1787868770.878504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1787868770.878514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+37:11366:x1874715918524800:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1787868770.878820:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+38:11366:x1874715918524800:12345-192.168.204.27@tcp:35:bash.0 Request processed in 307us (826us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787868770.878829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1787868770.884578:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874715939577728:192.168.204.27@tcp:105: 00010000:00010000:1.0:1787868770.884606:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868770.884697:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918524544:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 18835us (20839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868770.884709:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868771.130269:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.130376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918524928 00000100:00100000:1.0:1787868771.130386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918524928 00000100:00100000:1.0:1787868771.130467:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:1.0:1787868771.130478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+38:11382:x1874715918524928:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868771.130503:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868771.130525:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d7e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0a2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130618:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130643:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130657:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868771.130702:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787868771.130706:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868771.130726:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130752:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d7e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a2 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130776:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a2 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.130909:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868771.130912:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787868771.130915:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1600, rc 0) 00000100:00100000:1.0:1787868771.130981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+39:11382:x1874715918524928:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 505us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.130988:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00080000:2.0:1787868771.131137:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868771.142777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.143253:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525184 00000100:00100000:1.0:1787868771.143264:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525184 00000100:00100000:1.0:1787868771.143340:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:1.0:1787868771.143351:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+39:11382:x1874715918525184:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868771.143373:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868771.143393:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d7f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0a9 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.143624:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d7fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.143651:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.143662:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868771.143672:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787868771.144046:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d7f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a9 expref: 42 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.144088:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d7fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a9 expref: 41 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.144096:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:1.0:1787868771.144099:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868771.144103:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0800, rc 0) 00000100:00100000:1.0:1787868771.144692:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+41:11382:x1874715918525184:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1340us (1922us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787868771.145130:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:3.0:1787868771.159245:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868771.159677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525440 00000100:00100000:2.0:1787868771.159688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525440 00000100:00100000:2.0:1787868771.159761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:2.0:1787868771.159772:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+41:11382:x1874715918525440:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868771.160411:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868771.160436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d80a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0b0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.160562:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.160577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.160588:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868771.160600:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787868771.160730:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d80a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b0 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.162084:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b0 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.162094:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:2.0:1787868771.162098:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787868771.162101:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031600, rc 0) 00000100:00100000:2.0:1787868771.162289:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+43:11382:x1874715918525440:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 2516us (3052us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787868771.162309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:0.0:1787868771.178834:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.179076:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525568 00000100:00100000:1.0:1787868771.179086:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525568 00000100:00100000:1.0:1787868771.179179:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868771.179192:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+43:2405:x1874715918525568:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868771.179218:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868771.179246:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d7fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a9 expref: 43 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.179275:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:1.0:1787868771.179280:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868771.179341:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+42:2405:x1874715918525568:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 151us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.179348:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868771.197354:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868771.198932:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525696 00000100:00100000:2.0:1787868771.198951:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525696 00000100:00100000:2.0:1787868771.199101:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1787868771.199113:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918525696:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:2.0:1787868771.199194:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.199226:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.199236:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787868771.199241:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868771.199246:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.199284:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.199323:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 8 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868771.199338:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1874715939577856:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868771.199447:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868771.209537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.209759:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525824 00000100:00100000:1.0:1787868771.209768:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525824 00002000:00100000:1.0:1787868771.209830:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93dab7ffe940 x1874715918525824/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:92/0 lens 504/0 e 0 to 0 dl 1787868782 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868771.209854:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7ffe940 with x1874715918525824 ext(0->8) 00010000:00010000:1.0:1787868771.209864:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.209880:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868771.209889:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93dab7ffe940 00000100:00100000:1.0:1787868771.209925:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1787868771.209936:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918525824:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:2.0:1787868771.211418:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1874715939577856:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868771.211449:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868771.212576:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918525824:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 2636us (3042us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787868771.212588:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00100000:1.0:1787868771.212600:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93dab7ffe940 x1874715918525824/t4294967303(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:92/0 lens 504/448 e 0 to 0 dl 1787868782 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868771.212609:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93dab7ffe940 with x1874715918525824 ext(0->8) 00010000:00010000:1.0:1787868771.212617:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.212643:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868771.212651:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93dab7ffe940 00000100:00100000:0.0:1787868771.219054:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.221317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918525952 00000100:00100000:3.0:1787868771.221352:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918525952 00010000:00010000:3.0:1787868771.221403:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868771.221453:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:3.0:1787868771.221464:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918525952:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868771.221480:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787868771.221499:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787868771.221503:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787868770 00002000:00010000:3.0:1787868771.221505:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787868771 00002000:00010000:3.0:1787868771.221508:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787868770 00002000:00010000:3.0:1787868771.221511:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787868771.221517:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.221532:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.221559:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc68ae1/0x2f11f4d3bde2d7e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff09b expref: 11 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.221577:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868771.221622:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868771.221655:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.221667:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.221763:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868771.222394:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+10:2403:x1874715918525952:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 929us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.222405:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00010000:00010000:2.0:1787868771.223092:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223106:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223133:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223141:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223182:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223218:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868771.223222:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223232:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223251:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.223260:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2d81f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868771.223344:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918525696:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 24231us (25999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868771.223352:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1787868771.233073:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.233247:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918526208 00000100:00100000:3.0:1787868771.233258:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918526208 00000100:00100000:3.0:1787868771.233429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1787868771.233439:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e34c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+42:11382:x1874715918526208:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:3.0:1787868771.233501:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b0 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868771.233684:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787868771.233715:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787868771.235925:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787868771.236075:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.236095:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.236263:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.236385:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.236450:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 46 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868771.236464:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b4f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939577984:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868771.236606:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787868771.241615:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.241955:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918526336 00000100:00100000:3.0:1787868771.241967:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918526336 00010000:00010000:3.0:1787868771.242008:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 47 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868771.242051:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1787868771.242061:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+47:2403:x1874715918526336:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868771.242075:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868771.242081:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 47 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.242094:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 47 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.242132:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:3.0:1787868771.242137:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.242153:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.242180:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.242210:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868771.242481:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+47:2403:x1874715918526336:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 420us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.242490:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00010000:00010000:1.0:1787868771.243053:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d7cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff08d expref: 46 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868771.243084:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b4f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939577984:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868771.243107:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.243117:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.243122:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868771.243407:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787868771.243523:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787868771.243613:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939578112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787868771.243676:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.243902:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99da2000 going to sleep for 11 seconds 00000100:00100000:3.0:1787868771.245637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578112 00000100:00100000:3.0:1787868771.245651:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578112 00000100:00100000:2.0:1787868771.246004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868771.246016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1874715939578112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787868771.246624:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1874715939578112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 609us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868771.246633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787868771.246730:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939578112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787868771.246899:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787868771.246969:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939578240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787868771.247011:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868771.247040:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99fca780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868771.247210:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578240 00000100:00100000:0.0:1787868771.247216:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578240 00000100:00100000:0.0:1787868771.247254:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787868771.247263:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874715939578240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787868771.247388:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6516:x1874715939578240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (375us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787868771.247410:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787868771.247653:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939578240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787868771.247701:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787868771.247735:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247747:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247760:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247767:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868771.247772:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247780:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247854:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:3.0:1787868771.247857:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787868771.247862:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.247869:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d826 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787868771.247957:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787868771.248020:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787868771.248031:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395373874436ns, next at 396373872272ns, rc = 0 00000001:00080000:3.0:1787868771.248037:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787868771.248060:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dab5b3fa00) 00010000:00010000:3.0:1787868771.248063:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787868771.248071:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d811 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b0 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868771.248323:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e34c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+49:11382:x1874715918526208:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 14884us (15258us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787868771.248343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000020:00080000:3.0:1787868771.248347:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787868771.248584:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868771.251704:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.251893:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918526464 00000100:00100000:1.0:1787868771.251902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918526464 00000100:00100000:1.0:1787868771.251964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:1.0:1787868771.251975:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+49:11382:x1874715918526464:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868771.251999:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868771.252020:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d82d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0b7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.252077:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d82d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b7 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.252111:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d82d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b7 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.252129:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868771.252132:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787868771.252136:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0800, rc 0) 00000100:00100000:1.0:1787868771.252240:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+50:11382:x1874715918526464:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 266us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.252247:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:2.0:1787868771.256519:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.256715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918526720 00000100:00100000:3.0:1787868771.256725:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918526720 00000100:00100000:3.0:1787868771.256792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1787868771.256802:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+50:11382:x1874715918526720:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868771.257041:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+51:11382:x1874715918526720:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 240us (533us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787868771.257049:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787868771.399363:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868771.399537:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918526848 00000100:00100000:0.0:1787868771.399547:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918526848 00000100:00100000:0.0:1787868771.399612:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:0.0:1787868771.399623:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+51:11392:x1874715918526848:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1787868771.399702:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399721:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399743:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399756:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399763:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399770:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399846:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399855:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399862:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868771.399923:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399949:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399956:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399963:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399969:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868771.399973:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399980:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.399993:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868771.399996:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868771.400000:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400006:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d834 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400019:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400025:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400037:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400042:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868771.400045:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400058:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400065:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:0.0:1787868771.400068:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868771.400071:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400078:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d83b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400088:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400094:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400099:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400103:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868771.400106:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400122:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400131:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.400134:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868771.400137:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.400460:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d842 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868771.400599:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+51:11392:x1874715918526848:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 976us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868771.400608:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 112 00010000:00010000:2.0:1787868771.428708:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868771.500507:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868771.500671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918527104 00000100:00100000:0.0:1787868771.500681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918527104 00000100:00100000:0.0:1787868771.500753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:0.0:1787868771.500765:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+51:11395:x1874715918527104:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868771.500786:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868771.500805:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0be expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500879:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500894:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500905:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500942:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500951:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.500958:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501065:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d85e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501074:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501081:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868771.501091:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787868771.501225:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501233:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501240:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501246:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868771.501250:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501267:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868771.501283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868771.501288:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501817:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d850 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501832:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501838:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501845:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501850:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868771.501852:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501859:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501869:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:0.0:1787868771.501872:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868771.501875:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501890:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d857 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.501986:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2d849 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0be expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.502002:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d85e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0be expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.502010:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.502013:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868771.502015:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:0.0:1787868771.502124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+53:11395:x1874715918527104:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1361us (1624us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787868771.502131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:2.0:1787868771.507623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.507717:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918527232 00000100:00100000:3.0:1787868771.507727:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918527232 00000100:00100000:3.0:1787868771.507825:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:3.0:1787868771.507836:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+53:11395:x1874715918527232:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1787868771.507909:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.507927:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.507953:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.507992:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508000:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508007:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508027:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868771.508031:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508038:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508051:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868771.508054:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868771.508059:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.508065:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d86c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868771.508192:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+53:11395:x1874715918527232:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 321us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.508212:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:2.0:1787868771.514398:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.514495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918527488 00000100:00100000:3.0:1787868771.514508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918527488 00000100:00100000:3.0:1787868771.514709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1787868771.514721:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+53:11395:x1874715918527488:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868771.514982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+54:11395:x1874715918527488:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 263us (594us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787868771.514989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1787868771.619080:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939578496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619259:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939579008:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619308:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939579520:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619354:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787868771.619361:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939578368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619691:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939578880:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619740:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939579392:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619790:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939578624:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619826:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619847:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939579136:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619890:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939579648:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619939:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787868771.619945:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939578752:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.619965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.619974:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939579264:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.620005:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.620019:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939579776:0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.620039:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868771.620073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578368 00000100:00100000:1.0:1787868771.620080:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578368 00000100:00100000:1.0:1787868771.620124:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787868771.620143:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939578368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868771.620224:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939578368:12345-0@lo:400:kworker.0 Request processed in 92us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.620232:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787868771.620259:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579648 00000100:00100000:1.0:1787868771.620263:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579648 00000100:00100000:3.0:1787868771.620454:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578880 00000100:00100000:3.0:1787868771.620458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578880 00000100:00100000:3.0:1787868771.620484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578624 00000100:00100000:3.0:1787868771.620493:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578624 00000100:00100000:3.0:1787868771.620511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787868771.620529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939578880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620570:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939578880:12345-0@lo:400:kworker.0 Request processed in 54us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787868771.620588:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787868771.620595:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939578624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620621:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939578624:12345-0@lo:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787868771.620645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578496 00000100:00100000:3.0:1787868771.620648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578496 00000100:00100000:3.0:1787868771.620664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579008 00000100:00100000:3.0:1787868771.620666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579008 00000100:00100000:3.0:1787868771.620677:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579520 00000100:00100000:3.0:1787868771.620679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579520 00000100:00100000:3.0:1787868771.620689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579392 00000100:00100000:3.0:1787868771.620691:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579392 00000100:00100000:3.0:1787868771.620701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579136 00000100:00100000:3.0:1787868771.620703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579136 00000100:00100000:3.0:1787868771.620714:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939578752 00000100:00100000:3.0:1787868771.620716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939578752 00000100:00100000:3.0:1787868771.620726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787868771.620731:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939578496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939578496:12345-0@lo:400:kworker.0 Request processed in 25us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620761:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787868771.620771:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787868771.620785:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939579008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939579008:12345-0@lo:400:kworker.0 Request processed in 32us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787868771.620832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787868771.620837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939579520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620863:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939579520:12345-0@lo:400:kworker.0 Request processed in 26us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620868:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787868771.620877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787868771.620882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620909:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939579392:12345-0@lo:400:kworker.0 Request processed in 26us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620914:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787868771.620925:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787868771.620930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939579136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.620956:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939579136:12345-0@lo:400:kworker.0 Request processed in 26us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.620961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787868771.620974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787868771.620980:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939578752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.621004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939578752:12345-0@lo:400:kworker.0 Request processed in 25us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.621009:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787868771.621217:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939579904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868771.621252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868771.621278:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868771.621284:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939580032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868771.621319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868771.621347:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939580032 00000100:00100000:0.0:1787868771.621351:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939580032 00000100:00100000:0.0:1787868771.621380:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787868771.621387:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3638:x1874715939580032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868771.621402:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868771.621439:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3638:x1874715939580032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868771.621454:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787868771.621499:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939580032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868771.621658:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579904 00000100:00100000:0.0:1787868771.621663:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579904 00000100:00100000:0.0:1787868771.621688:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787868771.621694:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939579904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868771.621718:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787868771.621755:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939579904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868771.621761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787868771.621788:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939579904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868771.621834:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939578752:0@lo:400:kworker.0 00000100:00100000:0.0:1787868771.621845:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939578624:0@lo:400:kworker.0 00010000:00080000:0.0:1787868771.621857:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9889b21c0 x1874715939579136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868771.621869:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939579136:0@lo:400:kworker.0 00000100:00080000:0.0:1787868771.621892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868771.621896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868771.621899:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868771.622718:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579264 00000100:00100000:1.0:1787868771.622725:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579264 00000100:00100000:2.0:1787868771.622873:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939580160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868771.622920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868771.622960:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939580160 00000100:00100000:2.0:1787868771.622964:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939580160 00000100:00100000:2.0:1787868771.623003:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787868771.623010:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939580160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868771.623025:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868771.623064:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939580160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868771.623070:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787868771.623110:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939580160:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787868771.623235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868771.623282:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939578368:0@lo:400:kworker.0 00000100:00100000:0.0:1787868771.623301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939578880:0@lo:400:kworker.0 00000100:00100000:0.0:1787868771.623313:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939579392:0@lo:400:kworker.0 00000100:00100000:0.0:1787868771.623334:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939578496:0@lo:400:kworker.0 00000100:00100000:0.0:1787868771.623345:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939579008:0@lo:400:kworker.0 00010000:00080000:0.0:1787868771.623358:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988a830c0 x1874715939579520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868771.623366:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939579520:0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629325:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939579776 00000100:00100000:3.0:1787868771.629362:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939579776 00000100:00100000:3.0:1787868771.629446:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868771.629457:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939579648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629576:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939579648:12345-0@lo:400:kworker.0 Request processed in 122us (9661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.629583:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787868771.629600:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787868771.629607:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939579264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629639:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939579264:12345-0@lo:400:kworker.0 Request processed in 33us (9634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.629644:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787868771.629655:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787868771.629661:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629689:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939579776:12345-0@lo:400:kworker.0 Request processed in 28us (9648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.629694:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787868771.629722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868771.629771:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939579264:0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629785:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939579776:0@lo:400:kworker.0 00000100:00100000:3.0:1787868771.629796:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939579648:0@lo:400:kworker.0 00000001:00080000:0.0:1787868771.642208:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787868771.642222:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787868771.657998:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.658119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918527744 00000100:00100000:3.0:1787868771.658130:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918527744 00000100:00100000:3.0:1787868771.658249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1787868771.658306:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+54:11405:x1874715918527744:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868771.658333:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868771.658337:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787868771.658366:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2d7ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0a2 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658391:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:2.0:1787868771.658397:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868771.658411:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d873 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0c5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658608:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d87a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658622:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d87a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658632:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d87a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868771.658662:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787868771.658931:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d873 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0c5 expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658948:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d87a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0c5 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.658961:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868771.658964:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868771.658966:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030600, rc 0) 00000100:00100000:2.0:1787868771.659087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+55:11405:x1874715918527744:12345-192.168.204.27@tcp:101:bash.0 Request processed in 827us (1097us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787868771.659095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1787868771.669051:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868771.669086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.669315:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918527872 00000100:00100000:3.0:1787868771.669325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918527872 00000100:00100000:3.0:1787868771.669385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:3.0:1787868771.669528:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+55:11405:x1874715918527872:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868771.669560:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868771.669580:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d888 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669617:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669632:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669643:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669754:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669774:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.669784:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868771.669787:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868771.669790:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c400, rc 0) 00000100:00100000:3.0:1787868771.669851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+56:11405:x1874715918527872:12345-192.168.204.27@tcp:101:bash.0 Request processed in 445us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.669858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1787868771.670617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528000 00000100:00100000:1.0:1787868771.670625:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528000 00000100:00100000:1.0:1787868771.670678:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1787868771.670687:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+56:2405:x1874715918528000:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868771.670708:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868771.670725:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d87a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0c5 expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.670740:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868771.670744:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868771.670785:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+55:2405:x1874715918528000:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 100us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.670791:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868771.682091:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868771.682621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528256 00000100:00100000:0.0:1787868771.682633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528256 00000100:00100000:0.0:1787868771.682697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:0.0:1787868771.682707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+55:11405:x1874715918528256:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:0.0:1787868771.682798:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868771.682830:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2d85e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0be expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.682850:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.682855:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868771.683039:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.683054:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.683063:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787868771.683104:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1787868771.683137:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cb936d0 reply state 00000000ae6edee7 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.683151:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.683201:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.683205:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868771.683207:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868771.683311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+57:11405:x1874715918528256:12345-192.168.204.27@tcp:36:bash.0 Request processed in 606us (1232us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787868771.683318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000020:00080000:0.0:1787868771.683323:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787868771.695252:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.695360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528384 00000100:00100000:1.0:1787868771.695372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528384 00000100:00100000:1.0:1787868771.695441:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:1.0:1787868771.695452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+57:11405:x1874715918528384:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1787868771.695479:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868771.695499:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d89d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695601:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695628:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868771.695657:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787868771.695662:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868771.695700:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695726:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d89d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695749:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.695756:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868771.695759:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868771.695762:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0c00, rc 0) 00000100:00100000:1.0:1787868771.695821:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+58:11405:x1874715918528384:12345-192.168.204.27@tcp:101:bash.0 Request processed in 371us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.695828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1787868771.700735:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.700830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528640 00000100:00100000:1.0:1787868771.700842:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528640 00000100:00100000:1.0:1787868771.700909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1787868771.700920:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+58:11405:x1874715918528640:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:1.0:1787868771.701208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+59:11405:x1874715918528640:12345-192.168.204.27@tcp:35:bash.0 Request processed in 288us (485us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787868771.701216:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1787868771.795766:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.796054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528768 00000100:00100000:1.0:1787868771.796065:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528768 00000100:00100000:1.0:1787868771.796130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1787868771.796141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+59:11411:x1874715918528768:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868771.796214:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868771.796251:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796316:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796330:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796343:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868771.796384:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787868771.796388:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868771.796406:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796429:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0da expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796450:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0da expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.796457:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868771.796460:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787868771.796463:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1e00, rc 0) 00000100:00100000:1.0:1787868771.796516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918528768:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 377us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.796523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:2.0:1787868771.805263:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.808795:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918528896 00000100:00100000:3.0:1787868771.808827:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918528896 00000100:00100000:3.0:1787868771.809148:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:3.0:1787868771.809526:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918528896:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868771.809550:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868771.809573:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d8b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0e1 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809642:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809657:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809668:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809680:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809688:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809695:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809778:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809788:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809795:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868771.809847:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787868771.809851:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868771.809871:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809884:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809892:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809898:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809905:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.809911:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868771.809915:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810115:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810130:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868771.810133:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868771.810138:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810145:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810203:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810209:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810215:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810220:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828de00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868771.810222:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810228:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810235:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:3.0:1787868771.810237:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868771.810241:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810246:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810407:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d8b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e1 expref: 62 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810426:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e1 expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.810445:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868771.810447:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868771.810450:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868771.810565:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+61:11411:x1874715918528896:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1046us (5315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.810572:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1787868771.815581:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868771.815670:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529024 00000100:00100000:0.0:1787868771.815680:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529024 00000100:00100000:0.0:1787868771.815744:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1787868771.815754:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+61:2406:x1874715918529024:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868771.815770:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868771.815795:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2d8ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e1 expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.815815:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.815821:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868771.815875:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+60:2406:x1874715918529024:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868771.815883:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1787868771.826635:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.826720:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529280 00000100:00100000:3.0:1787868771.826730:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529280 00000100:00100000:3.0:1787868771.826795:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1787868771.826805:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918529280:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868771.826827:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868771.826847:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d8d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0e8 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.826963:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.826977:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.826986:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.827021:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.827035:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 61 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868771.827063:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939580288:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868771.827201:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868771.829472:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939580288:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868771.829504:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868771.831382:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868771.831479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529408 00000100:00100000:1.0:1787868771.831501:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529408 00010000:00010000:1.0:1787868771.831541:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868771.831583:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:1.0:1787868771.831592:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+62:2404:x1874715918529408:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868771.831606:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868771.831613:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831627:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831650:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0d3 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831673:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868771.831679:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831689:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831697:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868771.831728:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868771.831788:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+61:2404:x1874715918529408:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 196us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868771.831808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00010000:00010000:2.0:1787868771.832676:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.832687:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868771.832723:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787868771.832856:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2d8d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 62 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.832877:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 61 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.832885:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868771.832887:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787868771.832890:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828de00, rc 0) 00000100:00100000:2.0:1787868771.832944:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+61:11411:x1874715918529280:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 6141us (6319us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787868771.832952:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:2.0:1787868771.837355:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868771.837506:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529664 00000100:00100000:0.0:1787868771.837514:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529664 00000100:00100000:0.0:1787868771.837583:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1787868771.837608:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+61:11411:x1874715918529664:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:0.0:1787868771.837624:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868771.837647:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2d82d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0b7 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868771.837668:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868771.837673:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868771.837729:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918529664:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 124us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868771.837736:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1787868771.840670:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868771.840756:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529792 00000100:00100000:2.0:1787868771.840766:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529792 00000100:00100000:2.0:1787868771.840826:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1787868771.840837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918529792:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:2.0:1787868771.840960:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.840978:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868771.840990:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787868771.841106:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787868771.841251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918529792:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 415us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868771.841259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1787868771.844969:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868771.845039:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918529920 00000100:00100000:3.0:1787868771.845048:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918529920 00000100:00100000:3.0:1787868771.845099:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1787868771.845108:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+60:11411:x1874715918529920:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868771.845128:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868771.845179:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0ef expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845242:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845253:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845271:0:13805:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845283:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845321:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868771.845324:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868771.845329:0:13805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868771.845337:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d600, rc 0) 00000100:00100000:3.0:1787868771.845383:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+61:11411:x1874715918529920:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 276us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868771.845390:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000004:00080000:0.0:1787868772.129435:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396255276375ns, next at 397255273215ns, rc = 0 00000100:00100000:0.0:1787868772.129797:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939580544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868772.129869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868772.129996:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939580544 00000100:00100000:1.0:1787868772.130004:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939580544 00000100:00100000:1.0:1787868772.130066:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787868772.130076:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939580544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868772.130111:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868772.130202:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939580544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.130209:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787868772.130393:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868772.130427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868772.130517:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939580416 00000100:00100000:1.0:1787868772.130532:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939580416 00000100:00100000:1.0:1787868772.130566:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787868772.130574:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939580416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868772.130614:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868772.130817:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939580416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 244us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.130823:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787868772.130904:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868772.130984:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939580544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868772.131214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868772.131223:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939580672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868772.131253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868772.131296:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939580672 00000100:00100000:2.0:1787868772.131300:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939580672 00000100:00100000:2.0:1787868772.131326:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868772.131332:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939580672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868772.131345:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868772.131377:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939580672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868772.131383:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787868772.131585:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939580672:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787868772.450058:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868772.574700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574744:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574826:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.574849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.575114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530304 00000100:00100000:1.0:1787868772.575125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530304 00000100:00100000:1.0:1787868772.575237:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530816 00000100:00100000:1.0:1787868772.575240:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530816 00000100:00100000:1.0:1787868772.575253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530176 00000100:00100000:1.0:1787868772.575255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530176 00000100:00100000:1.0:1787868772.575265:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530688 00000100:00100000:1.0:1787868772.575267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530688 00000100:00100000:1.0:1787868772.575284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:1.0:1787868772.575294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918530304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868772.575386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918530304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.575394:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:1.0:1787868772.575411:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:1.0:1787868772.575417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918530816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868772.575442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918530816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.575448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:1.0:1787868772.575459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 326 00000100:00100000:1.0:1787868772.575464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+61:2404:x1874715918530176:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868772.575487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+61:2404:x1874715918530176:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.575493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 326 00000100:00100000:1.0:1787868772.575504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:1.0:1787868772.575524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918530688:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868772.575547:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918530688:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.575554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:3.0:1787868772.575922:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530048 00000100:00100000:3.0:1787868772.575927:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530048 00000100:00100000:3.0:1787868772.575967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 387 00000100:00100000:3.0:1787868772.575975:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918530048:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868772.576004:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918530048:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.576009:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 387 00000100:00100000:3.0:1787868772.576038:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530560 00000100:00100000:3.0:1787868772.576041:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530560 00000100:00100000:3.0:1787868772.576067:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530432 00000100:00100000:3.0:1787868772.576069:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530432 00000100:00100000:3.0:1787868772.576087:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1787868772.576092:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918530560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868772.576117:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918530560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.576122:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1787868772.576142:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:3.0:1787868772.576148:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918530432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868772.576217:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918530432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 69us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.576224:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00080000:0.0:1787868772.576615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868772.576619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868772.576622:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868772.576624:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787868772.705499:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868772.705509:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868772.705558:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787868772.705568:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787868772.705758:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7ffd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939580800:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787868772.705940:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868772.725595:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7ffd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939580800:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787868772.727035:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.727134:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918530944 00000100:00100000:1.0:1787868772.727143:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918530944 00000100:00100000:1.0:1787868772.727238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:1.0:1787868772.727247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+61:11412:x1874715918530944:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787868772.727290:0:6514:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787868772.727419:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+61:11412:x1874715918530944:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 173us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.727427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:0.0:1787868772.740250:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.740399:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918531072 00000100:00100000:1.0:1787868772.740410:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918531072 00000100:00100000:1.0:1787868772.740474:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:1.0:1787868772.740484:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+61:11412:x1874715918531072:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787868772.740558:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740581:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740593:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740649:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740656:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740663:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740684:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740693:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740698:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868772.740758:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787868772.740763:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868772.740776:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740787:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740793:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740799:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740804:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868772.740807:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740814:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740826:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:1.0:1787868772.740829:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868772.740835:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740840:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2d8f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740860:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740875:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740880:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740885:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868772.740887:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740893:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740902:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff93dabc0a2300) 00010000:00010000:1.0:1787868772.740904:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868772.740906:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740912:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d8ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740925:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740931:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740936:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740941:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868772.740952:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740957:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740964:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868772.740967:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868772.740969:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.740974:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.741054:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+61:11412:x1874715918531072:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 571us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.741062:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1787868772.745773:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.745876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918531328 00000100:00100000:2.0:1787868772.745887:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918531328 00000100:00100000:2.0:1787868772.745948:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1787868772.745959:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+61:11412:x1874715918531328:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868772.745981:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868772.746016:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d90d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746139:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746193:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746207:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868772.746219:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787868772.746302:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746311:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746317:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746323:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.746327:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746335:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.746348:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868772.746351:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787868772.746357:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.747481:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d914 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.747537:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d90d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0f6 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.747550:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:2.0:1787868772.747553:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868772.747558:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d90d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0f6 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.747569:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031e00, rc 0) 00000100:00100000:2.0:1787868772.747643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918531328:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1685us (1881us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787868772.747652:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1787868772.757760:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.757870:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918531456 00000100:00100000:1.0:1787868772.757882:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918531456 00000100:00100000:1.0:1787868772.757958:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:1.0:1787868772.757970:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918531456:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787868772.758014:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787868772.758152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918531456:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 182us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.758211:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:0.0:1787868772.767018:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868772.767713:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918531712 00000100:00100000:3.0:1787868772.767724:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918531712 00000100:00100000:3.0:1787868772.767835:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:3.0:1787868772.767846:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918531712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868772.767866:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868772.767869:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787868772.767918:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2d8b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0da expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.767987:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868772.767993:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868772.768009:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d922 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff0fd expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787868772.768510:0:13805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787868772.768653:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.768668:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.768694:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.768752:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d922 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0fd expref: 64 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.768770:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0fd expref: 63 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.768777:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93da82a4df00) 00010000:00010000:3.0:1787868772.768781:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868772.768784:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c600, rc 0) 00000100:00100000:3.0:1787868772.768853:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+63:11412:x1874715918531712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1009us (1844us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787868772.768860:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:2.0:1787868772.786011:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.786198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918531968 00000100:00100000:1.0:1787868772.786209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918531968 00000100:00100000:1.0:1787868772.786527:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:1.0:1787868772.786540:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+63:11412:x1874715918531968:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787868772.786623:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868772.786649:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2d929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0fd expref: 63 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786674:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93da82a4df00) 00010000:00010000:1.0:1787868772.786685:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868772.786709:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786723:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786734:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786747:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786754:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786760:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786819:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786825:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786831:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786843:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868772.786848:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786855:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786863:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:1.0:1787868772.786866:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868772.786869:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786875:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2d937 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786924:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786930:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786935:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868772.786938:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786944:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786963:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfc4e046f (ffff93dabc0a2300) 00010000:00010000:1.0:1787868772.786965:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868772.786968:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868772.786974:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2d93e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfc4e046f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.787105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918531968:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 569us (1105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787868772.787120:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:0.0:1787868772.792988:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.803905:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918532096 00000100:00100000:2.0:1787868772.803925:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918532096 00000100:00100000:2.0:1787868772.804000:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:2.0:1787868772.804011:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+62:11412:x1874715918532096:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868772.804038:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868772.804071:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d945 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff104 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804134:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804203:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804216:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804341:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 64 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804363:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 63 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.804372:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868772.804374:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868772.804378:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031a00, rc 0) 00000100:00100000:2.0:1787868772.804454:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+63:11412:x1874715918532096:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 444us (11476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868772.804461:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:0.0:1787868772.812028:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868772.812708:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918532352 00000100:00100000:3.0:1787868772.812720:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918532352 00000100:00100000:3.0:1787868772.812784:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:3.0:1787868772.812795:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+63:11412:x1874715918532352:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868772.812908:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.812925:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.812936:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868772.813120:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1787868772.813228:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c1bafa7 reply state 000000009393e8f3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.813241:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.813249:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:3.0:1787868772.813477:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787868772.813482:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868772.816960:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+65:11412:x1874715918532352:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 4154us (4933us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787868772.816975:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:3.0:1787868772.824583:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.824678:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918532480 00000100:00100000:2.0:1787868772.824688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918532480 00000100:00100000:2.0:1787868772.824754:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:2.0:1787868772.824764:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+65:11412:x1874715918532480:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868772.824791:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868772.824812:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff10b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.824877:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.824907:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.824925:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868772.824928:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868772.824932:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031e00, rc 0) 00000100:00100000:2.0:1787868772.824990:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+66:11412:x1874715918532480:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 228us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868772.824997:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:3.0:1787868772.829056:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.829217:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918532608 00000100:00100000:0.0:1787868772.829231:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918532608 00000100:00100000:0.0:1787868772.829322:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1787868772.829334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918532608:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787868772.829643:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918532608:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 310us (601us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787868772.829650:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1787868772.842760:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.842983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918532864 00000100:00100000:1.0:1787868772.842993:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918532864 00000100:00100000:1.0:1787868772.843055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:1.0:1787868772.843065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+66:11412:x1874715918532864:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787868772.843599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+67:11412:x1874715918532864:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 533us (849us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787868772.843608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:1.0:1787868772.854999:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.855104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533120 00000100:00100000:0.0:1787868772.855421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533120 00000100:00100000:0.0:1787868772.855521:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:0.0:1787868772.855531:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+67:11412:x1874715918533120:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787868772.855647:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+67:11412:x1874715918533120:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 117us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868772.855668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:0.0:1787868772.860501:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868772.860592:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533248 00000100:00100000:3.0:1787868772.860602:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533248 00000100:00100000:3.0:1787868772.860684:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:3.0:1787868772.860695:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+67:11412:x1874715918533248:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868772.860719:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868772.860741:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d961 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff112 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860813:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860826:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860838:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868772.860889:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868772.860906:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860930:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d961 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff112 expref: 69 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860945:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff112 expref: 68 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.860953:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:3.0:1787868772.860956:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787868772.860959:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828cc00, rc 0) 00000100:00100000:3.0:1787868772.861010:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+68:11412:x1874715918533248:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 319us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.861017:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:3.0:1787868772.866243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.866546:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533376 00000100:00100000:0.0:1787868772.866557:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533376 00000100:00100000:0.0:1787868772.866614:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1787868772.866625:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+9:2406:x1874715918533376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868772.866644:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868772.866664:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff119 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868772.866692:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b664, blocks: 0x0 00010000:00010000:0.0:1787868772.866714:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1787868772.866719:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868772.866730:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.866748:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.866762:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287600, rc 0) 00000100:00100000:0.0:1787868772.866831:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+10:2406:x1874715918533376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 208us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868772.866838:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:1.0:1787868772.878313:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.878407:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533632 00000100:00100000:2.0:1787868772.878418:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533632 00000100:00100000:2.0:1787868772.878475:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:2.0:1787868772.878486:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+68:11412:x1874715918533632:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787868772.878607:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+68:11412:x1874715918533632:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868772.878615:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:3.0:1787868772.888772:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.888870:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533760 00000100:00100000:0.0:1787868772.888880:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533760 00000100:00100000:0.0:1787868772.888948:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1787868772.888957:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+10:11412:x1874715918533760:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868772.888977:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868772.888997:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff120 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.889026:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.889034:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787868772.889038:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868772.889043:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.889075:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.889088:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868772.889102:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7ffda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939580928:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868772.889240:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868772.902633:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7ffda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939580928:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868772.902678:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.902702:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:3.0:1787868772.902783:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+11:11412:x1874715918533760:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 13826us (14021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.902793:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1787868772.909806:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.910902:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918533888 00000100:00100000:2.0:1787868772.910917:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918533888 00010000:00010000:2.0:1787868772.910970:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868772.911065:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:2.0:1787868772.911078:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+11:2404:x1874715918533888:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868772.911095:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868772.911134:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.911150:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.911228:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca6e072b/0x2f11f4d3bde2d96f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff119 expref: 11 pid: 8430 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.911246:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868772.911250:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868772.911272:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.911283:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.911320:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868772.911336:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1874715939581056:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787868772.911424:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787868772.924766:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.924891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534016 00000100:00100000:0.0:1787868772.924900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534016 00002000:00100000:0.0:1787868772.924949:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93d988a83840 x1874715918534016/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:93/0 lens 504/0 e 0 to 0 dl 1787868783 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868772.924978:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d988a83840 with x1874715918534016 ext(0->12) 00002000:00010000:0.0:1787868772.924984:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d988a83840 00000100:00100000:0.0:1787868772.925018:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1787868772.925027:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918534016:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787868772.926201:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1874715939581056:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787868772.926228:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868772.926287:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+13:2404:x1874715918533888:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 15212us (16492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868772.926308:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1787868772.930102:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+12:2403:x1874715918534016:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 5062us (5332us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787868772.930120:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:0.0:1787868772.930135:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93d988a83840 x1874715918534016/t4294967309(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:93/0 lens 504/448 e 0 to 0 dl 1787868783 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868772.930146:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d988a83840 with x1874715918534016 ext(0->12) 00002000:00010000:0.0:1787868772.930153:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d988a83840 00000100:00100000:1.0:1787868772.938743:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868772.938882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534144 00000100:00100000:0.0:1787868772.938893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534144 00000100:00100000:0.0:1787868772.938956:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:0.0:1787868772.938966:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+68:11412:x1874715918534144:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787868772.956853:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787868772.956883:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787868772.956911:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787868772.956936:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93da99fcab40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787868772.956941:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93daa1904300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93da99fcae40 00000020:00080000:0.0:1787868772.956945:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93daa1904500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93da8137e600 00000004:00080000:0.0:1787868772.956970:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787868772.956996:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93daaf7ef900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787868772.957017:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93daaf7efe40 00000020:00080000:0.0:1787868772.957020:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d987efdc00 00000100:00100000:0.0:1787868772.957279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:11412:x1874715918534144:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 18308us (18542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868772.957291:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000020:00080000:3.0:1787868772.957316:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787868772.957398:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787868772.957422:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939581184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787868772.957511:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787868772.957818:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957833:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957841:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957849:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.957855:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957864:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957886:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93dab5b3f900) 00010000:00010000:2.0:1787868772.957890:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868772.957896:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957904:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2d67b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957930:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957939:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957946:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957963:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.957967:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957976:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.957989:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93dab5b3fb00) 00010000:00010000:2.0:1787868772.957993:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868772.957997:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939581312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787868772.957999:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.958011:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2d723 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.958045:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.958054:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.958061:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.958064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787868772.958074:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.958078:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.958086:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868772.958114:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939581184 00000100:00100000:0.0:1787868772.958129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939581184 00000100:00100000:0.0:1787868772.958247:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939581312 00000100:00100000:0.0:1787868772.958252:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939581312 00000100:00100000:0.0:1787868772.958278:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787868772.958289:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939581184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787868772.958330:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1787868772.958380:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a90b662, atime: 0x6a90b663, ctime: 0x6a90b662, blocks: 0x8 00010000:00010000:0.0:1787868772.958389:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958410:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1787868772.958416:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868772.958424:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958444:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958453:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958479:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958497:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787868772.958693:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939581184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 404us (1183us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787868772.958701:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787868772.958735:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787868772.958742:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939581312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787868772.958757:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1787868772.958775:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958790:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 11 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958798:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787868772.958801:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868772.958805:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958839:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 11 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.958855:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 11 pid: 8962 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868772.958880:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7ffcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939581440:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868772.958961:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787868772.959384:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:2.0:1787868772.959388:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868772.959394:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959401:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2d7a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959427:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959434:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959440:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959445:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.959449:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959456:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959465:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2100) 00010000:00010000:2.0:1787868772.959469:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868772.959472:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959477:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d7c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959513:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.959525:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00010000:00010000:2.0:1787868772.959536:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787868772.959547:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00010000:00010000:2.0:1787868772.959548:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959560:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.959563:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959570:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959585:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868772.959587:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868772.959591:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787868772.959597:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7f79e00, transno 4294967302 00010000:00010000:2.0:1787868772.959598:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2d896 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959617:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787868772.959620:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00010000:00010000:2.0:1787868772.959633:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959640:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.959654:0:3636:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93dab7f6e1c0 x1874715939581184/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787868788 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787868772.959659:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868772.959669:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787868772.959676:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7f6e1c0/2, rc 0, transno 4294967305 00010000:00010000:2.0:1787868772.959679:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868772.959687:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939581184:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787868772.959696:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868772.959702:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787868772.959705:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.959712:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2d953 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960380:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868772.960393:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960407:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868772.960413:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960424:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960446:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960455:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2d97d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.960483:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868772.960485:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868772.960487:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868772.964076:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868772.964326:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534272 00000100:00100000:3.0:1787868772.964340:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534272 00010000:00010000:3.0:1787868772.964403:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 12 pid: 8962 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868772.964496:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:3.0:1787868772.964509:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+12:2404:x1874715918534272:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868772.964529:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868772.964536:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 12 pid: 8962 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.964553:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 12 pid: 8962 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.964592:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868772.964598:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868772.964605:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.964617:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868772.964644:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868772.964726:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+12:2404:x1874715918534272:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 219us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868772.964734:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:1.0:1787868772.964935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868772.964966:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534400 00000100:00100000:1.0:1787868772.964971:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534400 00000100:00100000:1.0:1787868772.965001:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1787868772.965009:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+12:2405:x1874715918534400:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787868772.975297:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2d731 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff078 expref: 12 pid: 8962 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868772.975335:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7ffcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939581440:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868772.975375:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.975389:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.975397:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.975409:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.975417:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868772.975445:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868772.975939:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868772.975951:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.975961:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868772.975966:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.975976:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.976003:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.976038:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007adc454e/0x2f11f4d3bde2d984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.976065:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868772.976067:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868772.976069:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787868772.978385:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d988a81680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787868772.978422:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939581312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787868772.978505:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939581312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19519us (20198us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787868772.978539:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:3.0:1787868772.983637:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787868772.983692:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1787868772.985788:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918534400:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 20762us (20836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868772.985806:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1787868772.990343:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868772.990524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534656 00000100:00100000:2.0:1787868772.990539:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534656 00000100:00100000:2.0:1787868772.990619:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:2.0:1787868772.990630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+16:11412:x1874715918534656:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787868772.990707:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868772.990748:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2d968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff112 expref: 16 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.990779:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868772.990787:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868772.990829:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.990847:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.990859:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868772.991051:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049347d28 reply state 00000000ea873a93 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.991091:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868772.991097:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868772.991100:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868772.991103:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868772.993754:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+17:11412:x1874715918534656:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 3107us (3405us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1787868772.993770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:0.0:1787868772.997528:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868772.997644:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918534784 00000100:00100000:3.0:1787868772.997657:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918534784 00000100:00100000:3.0:1787868772.997765:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1787868772.997778:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918534784:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787868772.997960:0:8962:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787868772.997965:0:8962:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787868771 00002000:00010000:3.0:1787868772.997967:0:8962:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787868771 00002000:00010000:3.0:1787868772.997970:0:8962:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787868772 -> 1787868771 00002000:00010000:3.0:1787868772.997972:0:8962:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787868772.998037:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918534784:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 262us (521us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787868772.998046:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1787868773.006900:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868773.006999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535040 00000100:00100000:1.0:1787868773.007016:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535040 00000100:00100000:1.0:1787868773.007131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:1.0:1787868773.007147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+17:11412:x1874715918535040:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787868773.007587:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.007613:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 17 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.007651:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.007701:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 17 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.007719:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 17 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.007737:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a812c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939581568:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868773.007857:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5780 going to sleep for 11 seconds 00000100:00080000:0.0:1787868773.008136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868773.015793:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a812c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939581568:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868773.015837:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.015994:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868773.019545:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535168 00000100:00100000:3.0:1787868773.019568:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535168 00010000:00010000:3.0:1787868773.019643:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 18 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868773.019774:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:3.0:1787868773.019789:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+18:2403:x1874715918535168:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868773.019813:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868773.019821:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 18 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.019838:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 18 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.019900:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d94c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff104 expref: 18 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.019925:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:3.0:1787868773.019932:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.019943:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.019953:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.020005:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868773.020119:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+17:2403:x1874715918535168:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 333us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868773.020129:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00010000:00010000:1.0:1787868773.022640:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022667:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022727:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022735:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022742:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022749:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868773.022754:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022788:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022812:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:1.0:1787868773.022816:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787868773.022821:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.022828:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2d992 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.022987:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+16:11412:x1874715918535040:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 15835us (16096us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787868773.022999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:1.0:1787868773.031360:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868773.031678:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535296 00000100:00100000:2.0:1787868773.031692:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535296 00000100:00100000:2.0:1787868773.031769:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1787868773.031785:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918535296:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787868773.031862:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.031891:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.031903:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868773.031909:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868773.031914:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.031982:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.032000:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 7 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868773.032020:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939581696:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868773.032738:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868773.038474:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939581696:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868773.038521:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.038583:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868773.038622:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535424 00000100:00100000:0.0:1787868773.038632:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535424 00010000:00010000:0.0:1787868773.038682:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 8 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.038724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:0.0:1787868773.038737:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918535424:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868773.038760:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868773.038791:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 8 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.038805:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 8 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.038836:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2d976 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff120 expref: 8 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.038880:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868773.038886:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868773.038892:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.038903:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.038933:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868773.038997:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918535424:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 263us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868773.039005:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00010000:00010000:0.0:1787868773.039036:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039045:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039069:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039078:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039086:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039101:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868773.039107:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039117:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039130:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.039137:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc8b8bd/0x2f11f4d3bde2d999 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.041840:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918535296:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 10040us (10479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868773.041860:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1787868773.045948:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868773.046069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535680 00000100:00100000:0.0:1787868773.046083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535680 00000100:00100000:0.0:1787868773.046586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:0.0:1787868773.046600:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+16:11412:x1874715918535680:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787868773.046719:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.046741:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.046776:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.046829:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.046847:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 16 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.046866:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939581824:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868773.047001:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868773.054789:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939581824:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868773.054836:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868773.059430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868773.059688:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535808 00000100:00100000:1.0:1787868773.059703:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535808 00010000:00010000:1.0:1787868773.059767:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.059819:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:1.0:1787868773.059834:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+17:2404:x1874715918535808:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868773.059857:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868773.059866:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.059882:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.059939:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2d88f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0cc expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.059965:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868773.059972:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 16 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.059985:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.059995:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.060003:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.060043:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868773.060116:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+16:2404:x1874715918535808:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 285us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868773.060125:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00010000:00010000:2.0:1787868773.061054:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061069:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061556:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061579:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061589:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061654:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.061673:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 16 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868773.061691:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939581952:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868773.061796:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868773.066447:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939581952:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868773.066494:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.068821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868773.069606:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918535936 00000100:00100000:3.0:1787868773.069621:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918535936 00010000:00010000:3.0:1787868773.069680:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868773.069734:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:3.0:1787868773.069747:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+17:2404:x1874715918535936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868773.069766:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868773.069775:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.069822:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.069852:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2d95a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff10b expref: 17 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.069875:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:3.0:1787868773.069881:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.069892:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.069902:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868773.070013:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868773.070117:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+16:2404:x1874715918535936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 373us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868773.070127:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00010000:00010000:2.0:1787868773.073665:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.073690:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787868773.073869:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787868773.074042:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787868773.074087:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787868773.074586:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939582080:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787868773.074681:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868773.074738:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868773.074941:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939582080 00000100:00100000:3.0:1787868773.074952:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939582080 00000100:00100000:3.0:1787868773.075040:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787868773.075053:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1874715939582080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787868773.075233:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1874715939582080:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868773.075242:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787868773.075559:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868773.075778:0:6512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787868773.075786:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787868773.075825:0:6512:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93d988a81680 x1874715939581312/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787868788 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868773.075838:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939582080:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787868773.076014:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787868773.076104:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939582208:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787868773.076653:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868773.076689:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868773.076941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939582208 00000100:00100000:0.0:1787868773.076950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939582208 00000100:00100000:0.0:1787868773.077016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787868773.077027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1874715939582208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787868773.077556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6512:x1874715939582208:12345-0@lo:1000:mdt00_000.0 Request processed in 529us (900us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787868773.077565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787868773.077668:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874715939582208:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787868773.077723:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077734:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077743:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077750:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868773.077755:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077765:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077784:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:2.0:1787868773.077787:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868773.077792:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077799:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077827:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077834:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077852:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077857:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868773.077860:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077866:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868773.077876:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868773.077884:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077897:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077907:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.077943:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868773.077956:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939582336:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787868773.078039:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868773.087491:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874715939582336:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787868773.087572:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087585:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2d8ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087631:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087648:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087662:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087674:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087682:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087695:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868773.087699:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087708:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087722:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868773.087726:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868773.087741:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087747:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2d9ae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087759:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087765:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087771:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087777:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868773.087780:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087786:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087795:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:2.0:1787868773.087798:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868773.087801:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.087807:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2d9a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868773.088433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868773.089005:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+19:11412:x1874715918535680:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 42404us (43068us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787868773.089022:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000020:00080000:2.0:1787868773.089045:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787868773.089942:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868773.089961:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868773.090538:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787868773.090552:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868773.091775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918536064 00000100:00100000:3.0:1787868773.091798:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918536064 00000100:00100000:3.0:1787868773.091943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1787868773.091958:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+19:11411:x1874715918536064:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:3.0:1787868773.092233:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+19:11411:x1874715918536064:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 278us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868773.092243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1787868773.096925:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868773.097135:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868773.097479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918536576 00000100:00100000:1.0:1787868773.097493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918536576 00000100:00100000:1.0:1787868773.097576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:1.0:1787868773.097590:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+19:11411:x1874715918536576:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:1.0:1787868773.097844:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787868773.098117:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+19:11411:x1874715918536576:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 529us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868773.098148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:2.0:1787868773.104188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918536320 00000100:00100000:2.0:1787868773.104217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918536320 00000100:00100000:2.0:1787868773.104322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:2.0:1787868773.104336:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e34850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+19:11412:x1874715918536320:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787868773.104697:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787868773.104740:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787868773.104783:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104805:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104820:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104830:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104839:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104846:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868773.104872:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787868773.105037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e34850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+21:11412:x1874715918536320:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 703us (8126us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787868773.105047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000020:00080000:2.0:1787868773.105053:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787868773.106586:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868773.106602:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.106614:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868773.106619:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.106630:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.106653:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:0.0:1787868773.106656:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787868773.106661:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.106667:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2d9b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.106687:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868773.106688:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868773.106690:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868773.129635:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868773.129750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918536704 00000100:00100000:1.0:1787868773.129765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918536704 00000100:00100000:1.0:1787868773.129857:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:1.0:1787868773.129870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+21:11414:x1874715918536704:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868773.129913:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868773.129957:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2d9bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff127 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130049:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130068:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130084:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130101:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130109:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130115:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130742:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130783:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 22 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130793:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130838:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 22 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.130854:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 22 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.130872:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939582464:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868773.132592:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa07130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868773.148325:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868773.148471:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939582464:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868773.148511:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868773.152924:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918536960 00000100:00100000:2.0:1787868773.152983:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918536960 00000100:00100000:0.0:1787868773.154780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1787868773.155604:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+23:6176:x1874715918536960:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787868773.156579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+24:6176:x1874715918536960:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 1778us (8472us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787868773.156593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1787868773.164914:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868773.165061:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918537088 00000100:00100000:1.0:1787868773.165077:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918537088 00010000:00010000:1.0:1787868773.165561:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 24 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868773.165655:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:1.0:1787868773.165669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+24:2404:x1874715918537088:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868773.165695:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868773.165705:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 24 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165723:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 24 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165779:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2d8dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0e8 expref: 24 pid: 10190 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165814:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868773.165823:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165834:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165842:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868773.165885:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868773.165979:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+23:2404:x1874715918537088:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 313us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868773.165987:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00010000:00010000:0.0:1787868773.166549:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166560:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868773.166631:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787868773.166637:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868773.166663:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166679:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166690:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166697:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166704:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166724:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868773.166729:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166738:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166751:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:0.0:1787868773.166754:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868773.166758:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166764:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2d9c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166788:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166795:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166814:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166819:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868773.166822:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166828:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166853:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93dabc0a2e00) 00010000:00010000:0.0:1787868773.166855:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868773.166858:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166864:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2d9ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166913:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2d9bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff127 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166929:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff127 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868773.166936:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868773.166938:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868773.166940:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0000, rc 0) 00000100:00100000:0.0:1787868773.167012:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+22:11414:x1874715918536704:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 37143us (37394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868773.167024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00010000:00010000:3.0:1787868773.473880:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787868774.113759:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868774.113769:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868774.113792:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787868774.113800:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787868774.114702:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939582592:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787868774.115128:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868774.120068:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939582592:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868774.126906:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868774.126943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918537216 00000100:00100000:3.0:1787868774.126952:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918537216 00000100:00100000:3.0:1787868774.127004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:3.0:1787868774.127013:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:11426:x1874715918537216:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787868774.127074:0:6512:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787868774.127221:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:11426:x1874715918537216:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 208us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868774.127229:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:2.0:1787868774.133633:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868774.133709:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918537472 00000100:00100000:3.0:1787868774.133720:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918537472 00000100:00100000:3.0:1787868774.133816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1787868774.133827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+22:11426:x1874715918537472:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868774.133849:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868774.133871:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d9d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff12e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.133980:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d9df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.134006:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.134020:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868774.134033:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787868774.134194:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2d9d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff12e expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.134212:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d9df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff12e expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.134221:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868774.134224:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868774.134227:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:3.0:1787868774.134295:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:11426:x1874715918537472:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 471us (669us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787868774.134302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:2.0:1787868774.150135:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868774.150709:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868774.150755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918537856 00000100:00100000:2.0:1787868774.150766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918537856 00000100:00100000:2.0:1787868774.150824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:2.0:1787868774.150835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+24:11426:x1874715918537856:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787868774.151202:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868774.151224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868774.151235:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868774.151425:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918537600 00000100:00100000:3.0:1787868774.151430:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918537600 00000100:00100000:3.0:1787868774.151481:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787868774.151490:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+25:2406:x1874715918537600:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868774.151502:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868774.151520:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2d9df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff12e expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.151552:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868774.151557:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868774.151828:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+24:2406:x1874715918537600:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 338us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868774.151837:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00010000:00010000:3.0:1787868774.152119:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152129:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152136:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152153:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868774.152181:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152190:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152201:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868774.152203:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868774.152207:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868774.152214:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2d9ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868774.154808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+24:11426:x1874715918537856:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 3962us (4088us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787868774.154834:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000040:00080000:2.0:1787868774.156005:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787868774.156012:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787868774.158468:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787868774.158488:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868774.161271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868774.161495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538112 00000100:00100000:0.0:1787868774.161506:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538112 00000100:00100000:0.0:1787868774.161581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1787868774.161665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+24:11426:x1874715918538112:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787868774.162781:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+25:11426:x1874715918538112:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 257us (1006us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787868774.162795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000040:00080000:0.0:1787868774.278902:0:14259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868774.278911:0:14259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868774.279014:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787868774.279022:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787868774.499751:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868774.661702:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868774.661900:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538368 00000100:00100000:0.0:1787868774.661912:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538368 00000100:00100000:0.0:1787868774.661979:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1787868774.661990:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+25:11439:x1874715918538368:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868774.662016:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868774.662036:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d9f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff135 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.662219:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d9fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.662236:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d9fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.662247:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d9fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868774.662285:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787868774.662391:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2d9f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff135 expref: 28 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.662411:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d9fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff135 expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.662421:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:0.0:1787868774.662423:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787868774.662427:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286000, rc 0) 00000100:00100000:0.0:1787868774.662497:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+27:11439:x1874715918538368:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 510us (808us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787868774.662505:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:3.0:1787868774.673544:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868774.673792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538496 00000100:00100000:1.0:1787868774.673803:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538496 00000100:00100000:1.0:1787868774.673867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:1.0:1787868774.673879:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+27:11439:x1874715918538496:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1787868774.673947:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.673965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.673977:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674028:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674036:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674042:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674047:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868774.674051:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674058:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674071:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:1.0:1787868774.674074:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868774.674078:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868774.674085:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2da09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868774.674406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+27:11439:x1874715918538496:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 528us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868774.674415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:3.0:1787868774.818430:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868774.818809:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538624 00000100:00100000:0.0:1787868774.818820:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538624 00000100:00080000:3.0:1787868774.818956:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868774.819055:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1787868774.819066:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918538624:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1787868774.819085:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868774.819105:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2da10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff13c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868774.819141:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a90b663, atime: 0x6a90b663, ctime: 0x6a90b663, blocks: 0x8 00010000:00010000:0.0:1787868774.819217:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1787868774.819223:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868774.819234:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2da10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff13c expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.819274:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2da10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff13c expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868774.819288:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287e00, rc 0) 00000100:00100000:0.0:1787868774.819356:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918538624:12345-192.168.204.27@tcp:101:cat.0 Request processed in 292us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868774.819365:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1787868774.826989:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868774.827193:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538752 00000100:00100000:1.0:1787868774.827205:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538752 00002000:00100000:1.0:1787868774.827263:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93da9151cb40 x1874715918538752/t0(0) o3->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:95/0 lens 488/0 e 0 to 0 dl 1787868785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868774.827288:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93da9151cb40 with x1874715918538752 ext(0->4095) 00002000:00010000:1.0:1787868774.827294:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93da9151cb40 00000100:00100000:1.0:1787868774.827334:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868774.827343:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918538752:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:1.0:1787868774.827920:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918538752:12345-192.168.204.27@tcp:3:cat.0 Request processed in 575us (940us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787868774.827929:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00002000:00100000:1.0:1787868774.827937:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93da9151cb40 x1874715918538752/t0(0) o3->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:95/0 lens 488/4536 e 0 to 0 dl 1787868785 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868774.827945:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93da9151cb40 with x1874715918538752 ext(0->4095) 00002000:00010000:1.0:1787868774.827948:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93da9151cb40 00010000:00010000:0.0:1787868775.522769:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868776.227924:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868776.227933:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868776.227978:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787868776.227985:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787868776.354546:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868776.547365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868776.738177:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939582720:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738330:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939583232:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738399:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939583744:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738442:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939584256:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738504:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787868776.738511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939582848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.738523:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583232 00000100:00100000:1.0:1787868776.738532:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583232 00000100:00100000:2.0:1787868776.738539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738557:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939583360:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.738602:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939583872:0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.738626:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583744 00000100:00100000:2.0:1787868776.738627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868776.738634:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583744 00000100:00100000:2.0:1787868776.738662:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939582848 00000100:00100000:2.0:1787868776.738668:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939582848 00000100:00100000:0.0:1787868776.738688:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584256 00000100:00100000:0.0:1787868776.738692:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584256 00000100:00100000:2.0:1787868776.738716:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583360 00000100:00100000:2.0:1787868776.738721:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583360 00000100:00100000:0.0:1787868776.738728:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787868776.738740:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738750:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583872 00000100:00100000:2.0:1787868776.738754:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583872 00000100:00100000:1.0:1787868776.738773:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787868776.738780:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787868776.738787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939583232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.738792:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939582848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.738804:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939583744:12345-0@lo:400:kworker.0 Request processed in 65us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.738812:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787868776.738835:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787868776.738845:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939584256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.738850:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939583232:12345-0@lo:400:kworker.0 Request processed in 65us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868776.738852:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939582848:12345-0@lo:400:kworker.0 Request processed in 61us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868776.738866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787868776.738867:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787868776.738889:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939584256:12345-0@lo:400:kworker.0 Request processed in 47us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868776.738892:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787868776.738902:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787868776.738907:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939583360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787868776.738919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868776.738925:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868776.738929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868776.738959:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939582848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.738980:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787868776.738989:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.739002:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939583360:12345-0@lo:400:kworker.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868776.739010:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787868776.739041:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939583872:12345-0@lo:400:kworker.0 Request processed in 54us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868776.739049:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787868776.739290:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939583360:0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.739313:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939583872:0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.739324:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939583744:0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.739336:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939584256:0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.739343:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939584384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868776.739348:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939583232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.739381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868776.739491:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584384 00000100:00100000:2.0:1787868776.739497:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584384 00000100:00100000:2.0:1787868776.739531:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787868776.739547:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939584384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868776.739571:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868776.739611:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939584384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868776.739618:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787868776.739651:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939584384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868776.741687:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939582976:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.741758:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741799:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939583488:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.741817:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741836:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939584000:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.741849:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741863:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939584512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868776.741876:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741896:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868776.741900:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939583104:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.741913:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741923:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939583616:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.741957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.741977:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939584128:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.742001:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868776.742039:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939582720 00000100:00100000:3.0:1787868776.742046:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939582720 00000100:00100000:3.0:1787868776.742091:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787868776.742112:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939582720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.742224:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939582720:12345-0@lo:400:kworker.0 Request processed in 113us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868776.742224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583488 00000100:00100000:1.0:1787868776.742230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583488 00000100:00100000:3.0:1787868776.742236:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787868776.742269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584000 00000100:00100000:1.0:1787868776.742273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584000 00000100:00100000:3.0:1787868776.742275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583104 00000100:00100000:3.0:1787868776.742281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583104 00000100:00100000:1.0:1787868776.742292:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787868776.742302:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.742308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787868776.742319:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939584000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.742347:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939583488:12345-0@lo:400:kworker.0 Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868776.742355:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787868776.742364:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939584000:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868776.742370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787868776.742377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868776.742413:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939583104:12345-0@lo:400:kworker.0 Request processed in 37us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.743116:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939582976 00000100:00100000:0.0:1787868776.743128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939582976 00000100:00100000:0.0:1787868776.743193:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787868776.743202:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939582976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.743253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939582976:12345-0@lo:400:kworker.0 Request processed in 53us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.743260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787868776.743286:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939583616 00000100:00100000:0.0:1787868776.743290:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939583616 00000100:00100000:0.0:1787868776.743317:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584128 00000100:00100000:0.0:1787868776.743320:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584128 00000100:00100000:0.0:1787868776.743341:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787868776.743348:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939583616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.743379:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939583616:12345-0@lo:400:kworker.0 Request processed in 32us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.743385:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787868776.743396:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787868776.743402:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939584128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868776.743430:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939584128:12345-0@lo:400:kworker.0 Request processed in 29us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.743436:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787868776.743496:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939582720:0@lo:400:kworker.0 00000100:00100000:3.0:1787868776.744218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787868776.744302:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584512 00000100:00100000:3.0:1787868776.744306:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584512 00000100:00100000:3.0:1787868776.744342:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787868776.744349:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939584512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868776.744367:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787868776.744414:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939584512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868776.744420:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787868776.744471:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939584640:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787868776.745222:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868776.745228:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868776.745231:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868776.746412:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939583104:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.746429:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939583616:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.746449:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939584128:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.746462:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939582976:0@lo:400:kworker.0 00010000:00080000:2.0:1787868776.746476:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98830e940 x1874715939583488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868776.746486:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98830e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939583488:0@lo:400:kworker.0 00010000:00080000:2.0:1787868776.746496:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c51680 x1874715939584000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868776.746505:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939584000:0@lo:400:kworker.0 00000100:00100000:2.0:1787868776.746524:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939584512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868776.746861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868776.747508:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584640 00000100:00100000:0.0:1787868776.747516:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584640 00000100:00100000:0.0:1787868776.747636:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787868776.747646:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939584640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868776.747685:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787868776.747749:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939584640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868776.747758:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787868776.747794:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939584640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868776.749700:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000004:00080000:0.0:1787868777.251427:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401377267870ns, next at 402377248846ns, rc = 0 00000100:00100000:0.0:1787868777.251465:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939584768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868777.251534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868777.251600:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868777.251607:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da90f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939584896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868777.251629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868777.251785:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584768 00000100:00100000:3.0:1787868777.251795:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584768 00000100:00100000:3.0:1787868777.251853:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939584896 00000100:00100000:3.0:1787868777.251857:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939584896 00000100:00100000:3.0:1787868777.251878:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787868777.251889:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939584768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868777.251916:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939585024:0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1787868777.251922:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787868777.251978:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939584768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868777.251985:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787868777.252012:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787868777.252020:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939584896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868777.252030:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787868777.252056:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939584896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868777.252061:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787868777.252121:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da90f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939584896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868777.252126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868777.252145:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939584768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868777.252194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585024 00000100:00100000:2.0:1787868777.252198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585024 00000100:00100000:2.0:1787868777.252236:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787868777.252316:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939585024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868777.252346:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868777.252393:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939585024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868777.252457:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939585024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868777.260837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00010000:3.0:1787868777.569687:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868777.690361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868777.690412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868777.690433:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918538880 00000100:00100000:3.0:1787868777.690443:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868777.690445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918538880 00000100:00100000:3.0:1787868777.690474:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868777.690509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 389 00000100:00100000:3.0:1787868777.690518:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868777.690524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918538880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868777.690545:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868777.690571:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868777.690612:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918538880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868777.690621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 389 00000100:00100000:2.0:1787868777.690661:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539136 00000100:00100000:2.0:1787868777.690665:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539136 00000100:00100000:2.0:1787868777.690706:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539648 00000100:00100000:2.0:1787868777.690709:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539648 00000100:00100000:2.0:1787868777.690724:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539008 00000100:00100000:2.0:1787868777.690727:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539008 00000100:00100000:2.0:1787868777.690754:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539520 00000100:00100000:2.0:1787868777.690757:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539520 00000100:00100000:2.0:1787868777.690772:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:2.0:1787868777.690779:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918539136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868777.692247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 335 00000100:00100000:0.0:1787868777.692266:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918539648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868777.696286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:3.0:1787868777.696307:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:2405:x1874715918539008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868777.696317:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918539136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 5533us (5900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868777.696328:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:2.0:1787868777.696361:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:3.0:1787868777.696369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:2405:x1874715918539008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 70us (5850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868777.696379:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918539520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868777.696381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:3.0:1787868777.696408:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539392 00000100:00100000:3.0:1787868777.696416:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539392 00000100:00100000:2.0:1787868777.696428:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918539520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (5855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868777.696436:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:3.0:1787868777.696461:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539264 00000100:00100000:3.0:1787868777.696466:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539264 00000100:00100000:3.0:1787868777.696494:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1787868777.696502:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918539392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:2.0:1787868777.696525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868777.696531:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868777.696534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868777.696537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868777.696542:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918539392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (6097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868777.696551:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1787868777.696569:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:3.0:1787868777.696576:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da90f75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918539264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868777.696603:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918539264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (6058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868777.696609:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1787868777.697561:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da90f77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918539648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 5297us (7080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868777.697572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 335 00010000:00010000:0.0:1787868778.593424:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787868778.794543:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1787868778.794592:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787868778.794620:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d9870e8f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787868778.794625:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab713b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d9870e8300 00000020:00080000:2.0:1787868778.794628:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab713b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d987ee8a00 00000020:00080000:2.0:1787868778.794644:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787868778.794769:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1787868778.794842:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939585152:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1787868778.794850:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787868778.794911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868778.794972:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585152 00000100:00100000:3.0:1787868778.794986:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585152 00000100:00080000:1.0:1787868778.795020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868778.795045:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787868778.795067:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939585152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787868778.795217:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787868778.795222:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787868771 -> 1787868771 00010000:00010000:0.0:1787868778.795223:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795235:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795243:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795249:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868778.795254:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795262:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795278:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93dab5b3f200) 00010000:00010000:0.0:1787868778.795281:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868778.795286:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868778.795292:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2d98b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787868778.795380:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1787868771 -> 1787868771 00002000:00010000:3.0:1787868778.795383:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787868771 -> 1787868771 00002000:00010000:3.0:1787868778.795386:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787868778.795440:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3637:x1874715939585152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 385us (528us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787868778.795449:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787868778.795528:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7fbe1c0/2, rc 0, transno 4294967313 00000100:00100000:1.0:1787868778.795536:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939585152:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787868778.795647:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787868778.795654:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787868778.796296:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:3.0:1787868779.620543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868780.403903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868780.404107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539776 00000100:00100000:0.0:1787868780.404121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539776 00000100:00100000:0.0:1787868780.404404:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:0.0:1787868780.404418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+13:11100:x1874715918539776:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787868780.404570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+13:11100:x1874715918539776:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 154us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868780.404613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00080000:1.0:1787868780.404990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868780.410479:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868780.410546:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918539904 00000100:00100000:3.0:1787868780.410570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918539904 00000100:00100000:3.0:1787868780.410669:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:3.0:1787868780.410685:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:11100:x1874715918539904:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787868780.410834:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:11100:x1874715918539904:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 154us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868780.410843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00080000:2.0:1787868780.410975:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868780.413756:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868780.414449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540160 00000100:00100000:2.0:1787868780.414470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540160 00000100:00100000:2.0:1787868780.414563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1787868780.415105:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+13:11100:x1874715918540160:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787868780.415967:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+14:11100:x1874715918540160:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 480us (1830us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787868780.415981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00010000:00010000:3.0:1787868780.642184:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868780.815356:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868780.816361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540288 00000100:00100000:0.0:1787868780.816375:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540288 00000100:00100000:0.0:1787868780.816784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:0.0:1787868780.816797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:11898:x1874715918540288:12345-192.168.204.27@tcp:101:lsof.0 00010000:00010000:0.0:1787868780.816819:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868780.816841:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2da17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.816911:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.816925:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.816949:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787868780.816986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787868780.817006:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868780.817027:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868780.817069:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.817094:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2da17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.817125:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868780.817145:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:0.0:1787868780.817149:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868780.817152:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868780.817274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:11898:x1874715918540288:12345-192.168.204.27@tcp:101:lsof.0 Request processed in 480us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868780.817281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00010000:00010000:0.0:1787868781.665413:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868781.860149:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939585408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860323:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939585920:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860371:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939586432:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860416:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787868781.860424:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939585280:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860486:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939585792:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860561:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939586304:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860617:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939586816:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.860698:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585408 00000100:00100000:2.0:1787868781.860705:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585408 00000100:00100000:2.0:1787868781.860746:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585920 00000100:00100000:2.0:1787868781.860749:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585920 00000100:00100000:2.0:1787868781.860782:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586432 00000100:00100000:2.0:1787868781.860786:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586432 00000100:00100000:2.0:1787868781.860803:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787868781.860812:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939585408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860884:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939585408:12345-0@lo:400:kworker.0 Request processed in 72us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868781.860891:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787868781.860908:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787868781.860914:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939585920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.860954:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939585920:12345-0@lo:400:kworker.0 Request processed in 40us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868781.860961:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787868781.861007:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787868781.861015:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939586432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.861044:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939586432:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868781.861050:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787868781.861070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585792 00000100:00100000:2.0:1787868781.861073:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585792 00000100:00100000:2.0:1787868781.861111:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787868781.861117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939585792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.861148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939585792:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868781.861177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1787868781.861194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868781.861223:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939585792:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.861234:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939585408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.861242:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939585920:0@lo:400:kworker.0 00000100:00100000:2.0:1787868781.861251:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939586432:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861499:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939585536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861530:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861571:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939586048:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861621:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939586560:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861651:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861666:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868781.861672:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9883852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939585664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861701:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939586176:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861744:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939586688:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868781.861797:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585280 00000100:00100000:3.0:1787868781.861801:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585280 00000100:00100000:3.0:1787868781.861834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787868781.861840:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939585280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.861872:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939585280:12345-0@lo:400:kworker.0 Request processed in 32us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.861878:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787868781.861905:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586304 00000100:00100000:3.0:1787868781.861909:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586304 00000100:00100000:3.0:1787868781.861933:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586816 00000100:00100000:3.0:1787868781.861937:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586816 00000100:00100000:3.0:1787868781.861949:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586176 00000100:00100000:3.0:1787868781.861951:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586176 00000100:00100000:3.0:1787868781.861962:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586688 00000100:00100000:3.0:1787868781.861965:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586688 00000100:00100000:3.0:1787868781.861989:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787868781.862010:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862064:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939586304:12345-0@lo:400:kworker.0 Request processed in 69us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.862081:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787868781.862093:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787868781.862098:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939586816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862127:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939586816:12345-0@lo:400:kworker.0 Request processed in 29us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.862132:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787868781.862141:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787868781.862147:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939586176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862200:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939586176:12345-0@lo:400:kworker.0 Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.862206:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787868781.862216:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787868781.862221:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939586688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862247:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939586688:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.862252:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787868781.862270:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585536 00000100:00100000:3.0:1787868781.862273:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585536 00000100:00100000:3.0:1787868781.862292:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787868781.862297:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939585536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862326:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939585536:12345-0@lo:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.862332:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1787868781.862367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868781.862370:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868781.862399:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939586176:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862409:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939586688:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862418:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939585536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.862458:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586048 00000100:00100000:3.0:1787868781.862462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586048 00000100:00100000:3.0:1787868781.862505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586560 00000100:00100000:3.0:1787868781.862509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586560 00000100:00100000:3.0:1787868781.862521:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939585664 00000100:00100000:3.0:1787868781.862524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939585664 00000100:00100000:3.0:1787868781.862543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787868781.864123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939586048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868781.864223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939586048:12345-0@lo:400:kworker.0 Request processed in 118us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.864231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787868781.864257:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787868781.864264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939586560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868781.864396:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868781.864429:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939587072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868781.864474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868781.864518:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787868781.864528:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939585664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868781.864560:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939585664:12345-0@lo:400:kworker.0 Request processed in 35us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868781.864567:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787868781.864602:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587072 00000100:00100000:1.0:1787868781.864608:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587072 00000100:00100000:1.0:1787868781.864642:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787868781.864648:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939587072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868781.864671:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868781.864707:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939587072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868781.864713:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787868781.864746:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787868781.864751:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7f6e1c0, transno 4294967305 00000100:00100000:1.0:1787868781.864767:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939587072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868781.864903:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939586944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868781.864929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868781.864958:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939585280:0@lo:400:kworker.0 00000100:00100000:1.0:1787868781.864969:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939586304:0@lo:400:kworker.0 00000100:00100000:1.0:1787868781.864979:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787868781.864982:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d988a81680, transno 4294967310 00000004:00080000:1.0:1787868781.865016:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787868781.865034:0:3639:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93dab7fbe1c0 x1874715939585152/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787868794 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868781.865044:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939586816:0@lo:400:kworker.0 00000100:00080000:1.0:1787868781.865118:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868781.865144:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9883852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939585664:0@lo:400:kworker.0 00010000:00080000:1.0:1787868781.865177:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f570c0 x1874715939586048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868781.865188:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939586048:0@lo:400:kworker.0 00010000:00080000:1.0:1787868781.865199:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9889b6940 x1874715939586560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868781.865207:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939586560:0@lo:400:kworker.0 00000100:00100000:0.0:1787868781.865552:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939586944 00000100:00100000:0.0:1787868781.865557:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939586944 00000100:00100000:0.0:1787868781.865600:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787868781.865608:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939586944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868781.865622:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868781.865667:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939586944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868781.865674:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787868781.865713:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939586944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868781.866075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939586560:12345-0@lo:400:kworker.0 Request processed in 34us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868781.866082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787868781.866679:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868781.866693:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939587200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868781.866746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868781.866827:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587200 00000100:00100000:2.0:1787868781.866832:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587200 00000100:00100000:2.0:1787868781.867914:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787868781.867930:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939587200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868781.867980:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787868781.868072:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939587200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868781.868080:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787868781.868191:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939587200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868782.374501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939587328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868782.374577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868782.374843:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587328 00000100:00100000:3.0:1787868782.374853:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587328 00000100:00100000:3.0:1787868782.374909:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787868782.374929:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939587328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868782.374957:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787868782.375017:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939587328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868782.375036:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787868782.375227:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939587456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868782.375259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868782.375296:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587456 00000100:00100000:0.0:1787868782.375300:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587456 00000100:00100000:0.0:1787868782.375326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787868782.375333:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939587456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868782.375351:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787868782.375382:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939587456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868782.375388:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787868782.375434:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939587456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868782.375544:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939587328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868782.376305:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939587584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868782.376346:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868782.376426:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587584 00000100:00100000:3.0:1787868782.376431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587584 00000100:00100000:3.0:1787868782.376477:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787868782.376662:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939587584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868782.376691:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868782.376802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939587584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 318us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868782.376808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787868782.376855:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98733b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939587584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787868782.690269:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868782.812640:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.812696:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868782.812909:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540672 00000100:00100000:1.0:1787868782.812919:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540672 00000100:00100000:1.0:1787868782.813008:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:1.0:1787868782.813025:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918540672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868782.813120:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918540672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868782.813128:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00080000:3.0:1787868782.813592:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868782.813659:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540416 00000100:00100000:2.0:1787868782.813664:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540416 00000100:00100000:2.0:1787868782.813703:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 391 00000100:00100000:2.0:1787868782.813712:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918540416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868782.813762:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2404:x1874715918540416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 51us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868782.813769:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 391 00000100:00100000:0.0:1787868782.814414:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.814490:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.814517:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.814533:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.814548:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868782.814563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541184 00000100:00100000:0.0:1787868782.814567:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541184 00000100:00100000:0.0:1787868782.814602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540544 00000100:00100000:0.0:1787868782.814605:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540544 00000100:00100000:0.0:1787868782.814622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541056 00000100:00100000:0.0:1787868782.814625:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541056 00000100:00100000:0.0:1787868782.814641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:0.0:1787868782.814648:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918541184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868782.814689:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918541184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868782.814695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:0.0:1787868782.814710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:3.0:1787868782.814887:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540928 00000100:00100000:3.0:1787868782.814891:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540928 00000100:00100000:3.0:1787868782.814921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918540800 00000100:00100000:3.0:1787868782.814924:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918540800 00000100:00100000:3.0:1787868782.814945:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1787868782.814951:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918540928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868782.814996:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918540928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868782.815003:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1787868782.815014:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:3.0:1787868782.815020:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918540800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868782.815056:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918540800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868782.815071:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00080000:3.0:1787868782.815095:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868782.815098:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868782.815100:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868782.815102:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868782.815117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:3.0:1787868782.815123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2404:x1874715918541056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868782.815152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2404:x1874715918541056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868782.815188:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:0.0:1787868782.815505:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+14:2404:x1874715918540544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868782.815548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98830f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+14:2404:x1874715918540544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 817us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868782.815555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 346 00010000:00010000:3.0:1787868783.714512:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868784.738270:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868784.899977:0:14456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:13:03 (1787868783) 00000001:00080000:2.0:1787868784.941438:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787868784.947837:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1787868784.947854:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787868784.947897:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787868784.947911:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787868785.766645:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787868786.465471:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787868786.465480:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787868786.465599:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787868786.465607:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787868786.595225:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868786.661538:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868786.661758:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541440 00000100:00100000:0.0:1787868786.661772:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541440 00000100:00100000:0.0:1787868786.661886:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:0.0:1787868786.661899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+13:12165:x1874715918541440:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868786.662129:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868786.662448:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2da25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff14a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.662547:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663256:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663278:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663304:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663312:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663341:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663476:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2da3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663486:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2da3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.663493:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2da3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868786.663503:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000100:00080000:3.0:1787868786.663725:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787868786.664250:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664262:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664269:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664276:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868786.664280:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664289:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664305:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93dab5b3ff00) 00010000:00010000:0.0:1787868786.664308:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868786.664327:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664335:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2da2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664353:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664359:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664364:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664368:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868786.664370:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664376:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664383:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d9870c6400) 00010000:00010000:0.0:1787868786.664385:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868786.664388:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.664393:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2da33 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.667783:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2da25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff14a expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.667858:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2da3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff14a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868786.667868:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:0.0:1787868786.667872:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868786.667876:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:0.0:1787868786.668797:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98733b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+15:12165:x1874715918541440:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 6892us (7266us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787868786.668810:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1787868786.675642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868786.675698:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868786.675894:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541568 00000100:00100000:3.0:1787868786.675921:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541568 00000100:00100000:2.0:1787868786.676114:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541696 00000100:00100000:2.0:1787868786.676130:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541696 00000100:00100000:2.0:1787868786.676272:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1787868786.676285:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+16:2405:x1874715918541696:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868786.676303:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868786.676334:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2da3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff14a expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868786.676355:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:2.0:1787868786.676360:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868786.676412:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:3.0:1787868786.676432:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+15:12165:x1874715918541568:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787868786.676453:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+15:2405:x1874715918541696:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 169us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868786.676464:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1787868786.676564:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+14:12165:x1874715918541568:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 138us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868786.676574:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:0.0:1787868786.686793:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868786.686930:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541824 00000100:00100000:2.0:1787868786.686946:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541824 00000100:00100000:2.0:1787868786.687194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:2.0:1787868786.687207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:12165:x1874715918541824:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787868786.687346:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:12165:x1874715918541824:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 141us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868786.687354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00080000:3.0:1787868786.687666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787868786.785860:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868786.977553:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939587712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868786.977638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868786.977726:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587712 00000100:00100000:2.0:1787868786.977735:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587712 00000100:00100000:2.0:1787868786.977790:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787868786.977801:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939587712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868786.977832:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868786.977892:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939587712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868786.977911:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787868786.977963:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939587712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868786.978209:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939587968:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978272:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939588480:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939588992:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978357:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787868786.978362:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939587840:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939588352:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978453:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939588864:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978501:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939588224:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978541:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939588736:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978581:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939589248:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978619:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868786.978624:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939588096:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978664:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939588608:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978716:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939589120:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.978760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587968 00000100:00100000:1.0:1787868786.978764:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587968 00000100:00100000:1.0:1787868786.978787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588480 00000100:00100000:1.0:1787868786.978789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588480 00000100:00100000:1.0:1787868786.978801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588992 00000100:00100000:1.0:1787868786.978803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588992 00000100:00100000:1.0:1787868786.978813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588864 00000100:00100000:1.0:1787868786.978815:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588864 00000100:00100000:1.0:1787868786.978825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588224 00000100:00100000:1.0:1787868786.978827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588224 00000100:00100000:1.0:1787868786.978835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588608 00000100:00100000:1.0:1787868786.978837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588608 00000100:00100000:1.0:1787868786.978849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787868786.978855:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939587968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939587968:12345-0@lo:400:kworker.0 Request processed in 57us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.978919:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787868786.978933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787868786.978939:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939588480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.978963:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939588480:12345-0@lo:400:kworker.0 Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.978968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787868786.978977:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787868786.978982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939588992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939588992:12345-0@lo:400:kworker.0 Request processed in 24us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979022:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787868786.979034:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787868786.979039:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939588864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979067:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939588864:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979072:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787868786.979081:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787868786.979087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939588224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979116:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939588224:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787868786.979132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787868786.979138:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979193:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939588608:12345-0@lo:400:kworker.0 Request processed in 55us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787868786.979220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939587840 00000100:00100000:1.0:1787868786.979223:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939587840 00000100:00100000:1.0:1787868786.979247:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787868786.979252:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939587840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979279:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3639:x1874715939587840:12345-0@lo:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787868786.979313:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588352 00000100:00100000:1.0:1787868786.979317:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588352 00000100:00100000:1.0:1787868786.979352:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588096 00000100:00100000:1.0:1787868786.979355:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588096 00000100:00100000:1.0:1787868786.979369:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787868786.979374:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939588352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979408:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939588352:12345-0@lo:400:kworker.0 Request processed in 34us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979414:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787868786.979426:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787868786.979433:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939588096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979458:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939588096:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979464:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787868786.979488:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939588736 00000100:00100000:1.0:1787868786.979492:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939588736 00000100:00100000:1.0:1787868786.979515:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589248 00000100:00100000:1.0:1787868786.979518:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589248 00000100:00100000:1.0:1787868786.979529:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589120 00000100:00100000:1.0:1787868786.979531:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589120 00000100:00100000:1.0:1787868786.979542:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787868786.979547:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939588736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979574:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939588736:12345-0@lo:400:kworker.0 Request processed in 27us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979580:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787868786.979589:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787868786.979594:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939589248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979616:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939589248:12345-0@lo:400:kworker.0 Request processed in 22us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979630:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787868786.979640:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787868786.979645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939589120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979669:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939589120:12345-0@lo:400:kworker.0 Request processed in 25us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.979674:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787868786.979721:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939588096:0@lo:400:kworker.0 00010000:00080000:1.0:1787868786.979734:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da9393d2c0 x1874715939588608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868786.979743:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939588608:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979752:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939589120:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979761:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939588224:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979769:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939588736:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979777:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787868786.979781:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7fbe1c0, transno 4294967313 00000100:00100000:1.0:1787868786.979791:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939589248:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979932:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939587840:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939588352:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979951:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939588864:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979959:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939587968:0@lo:400:kworker.0 00000100:00100000:1.0:1787868786.979978:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939588480:0@lo:400:kworker.0 00010000:00080000:1.0:1787868786.979987:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c0f00 x1874715939588992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868786.979996:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939588992:0@lo:400:kworker.0 00000100:00080000:3.0:1787868786.980698:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868786.980705:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868786.980707:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868786.980709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868786.981699:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939589376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868786.981767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868786.981870:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589376 00000100:00100000:1.0:1787868786.981878:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589376 00000100:00100000:1.0:1787868786.982246:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787868786.982255:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939589376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868786.982290:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787868786.982337:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939589376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868786.982343:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787868786.982446:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939589376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868786.982843:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939589504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868786.982885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868786.983918:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589504 00000100:00100000:2.0:1787868786.983944:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589504 00000100:00100000:2.0:1787868786.984005:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787868786.984014:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939589504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868786.984034:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868786.984544:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939589504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 531us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868786.984552:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787868786.984647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939589504:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787868787.490810:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868787.490820:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868787.493584:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787868787.493602:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868787.493756:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939589632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868787.493824:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868787.493899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589632 00000100:00100000:3.0:1787868787.493907:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589632 00000100:00100000:3.0:1787868787.493948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787868787.493957:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939589632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868787.494388:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868787.494437:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939589632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 480us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868787.494445:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787868787.494470:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939589760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868787.494498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868787.494562:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939589632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868787.494945:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589760 00000100:00100000:0.0:1787868787.494951:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589760 00000100:00100000:0.0:1787868787.494997:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787868787.495006:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939589760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868787.495026:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787868787.495077:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939589760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868787.495083:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787868787.497318:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939589760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868787.498264:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939589888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868787.498331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868787.498391:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939589888 00000100:00100000:1.0:1787868787.498397:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939589888 00000100:00100000:1.0:1787868787.498437:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787868787.498446:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939589888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868787.498466:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787868787.498502:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939589888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.498510:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787868787.498548:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939589888:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787868787.618791:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787868787.809423:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868787.930553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930608:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930660:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930680:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868787.930724:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868787.930830:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542208 00000100:00100000:1.0:1787868787.930843:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542208 00000100:00100000:1.0:1787868787.930931:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542720 00000100:00100000:1.0:1787868787.930934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542720 00000100:00100000:1.0:1787868787.930958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542080 00000100:00100000:1.0:1787868787.930961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542080 00000100:00100000:1.0:1787868787.930987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542592 00000100:00100000:1.0:1787868787.930990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542592 00000100:00100000:1.0:1787868787.931015:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 354 00000100:00100000:1.0:1787868787.931026:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918542208:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931128:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918542208:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 103us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 354 00000100:00100000:1.0:1787868787.931196:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:1.0:1787868787.931204:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918542720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2405:x1874715918542720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:1.0:1787868787.931250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:1.0:1787868787.931256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:2405:x1874715918542080:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931281:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:2405:x1874715918542080:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931288:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:1.0:1787868787.931303:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00100000:1.0:1787868787.931309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2405:x1874715918542592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931333:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2405:x1874715918542592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00100000:1.0:1787868787.931383:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542464 00000100:00100000:1.0:1787868787.931387:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542464 00000100:00100000:1.0:1787868787.931418:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542336 00000100:00100000:1.0:1787868787.931420:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542336 00000100:00100000:1.0:1787868787.931440:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:1.0:1787868787.931447:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918542464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931477:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2405:x1874715918542464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931484:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:1.0:1787868787.931496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1787868787.931502:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918542336:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868787.931527:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2405:x1874715918542336:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868787.931533:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1787868787.932067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918541952 00000100:00100000:3.0:1787868787.932075:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918541952 00000100:00100000:3.0:1787868787.932120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 393 00000100:00100000:3.0:1787868787.932128:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918541952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868787.932197:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2405:x1874715918541952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 70us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868787.932205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 393 00000100:00080000:3.0:1787868787.932242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868787.932247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868787.932249:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868787.932252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868788.702410:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.702616:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918542848 00000100:00100000:2.0:1787868788.702629:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918542848 00000100:00100000:2.0:1787868788.702716:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00100000:2.0:1787868788.702729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:12207:x1874715918542848:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868788.702758:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868788.702790:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff151 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703066:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703086:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703112:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703214:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703224:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703584:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703594:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703602:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703609:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.703614:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703624:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703638:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868788.703641:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.703647:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703661:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703679:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703687:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703693:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703699:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.703703:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703709:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703719:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93daafdb5200) 00010000:00010000:2.0:1787868788.703721:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.703724:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703731:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703777:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff151 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703802:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868788.703805:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.703809:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff151 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.703820:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031a00, rc 0) 00000100:00100000:2.0:1787868788.704096:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+14:12207:x1874715918542848:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1367us (1700us total) trans 0 rc 301/301 00000100:00100000:2.0:1787868788.704107:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00080000:2.0:1787868788.704249:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868788.712008:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868788.712415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543104 00000100:00100000:0.0:1787868788.712431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543104 00000100:00100000:2.0:1787868788.712618:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:2.0:1787868788.712635:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+14:12207:x1874715918543104:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1787868788.712722:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868788.712761:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2d39c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef75 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.712789:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868788.712795:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868788.713397:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.713419:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.713430:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.713654:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.713678:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 5 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868788.713696:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1874715939590016:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868788.713881:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868788.719045:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868788.719347:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1874715939590016:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868788.719385:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868788.719959:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543232 00000100:00100000:0.0:1787868788.719987:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543232 00010000:00010000:0.0:1787868788.720045:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 6 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868788.720135:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:0.0:1787868788.720148:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2404:x1874715918543232:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868788.720195:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868788.720204:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 6 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720221:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 6 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720252:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff143 expref: 6 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720436:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:0.0:1787868788.720444:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720457:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720467:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.720572:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868788.720650:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918543232:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 504us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868788.720670:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00010000:00010000:2.0:1787868788.720750:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.720759:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.720791:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.720802:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.720811:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721595:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721617:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721635:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868788.721655:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6de2981 reply state 00000000ea4a90b2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721668:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721675:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868788.721678:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868788.721681:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787868788.721689:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787868788.721697:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721704:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721711:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721717:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.721722:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721729:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721739:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93da88316300) 00010000:00010000:2.0:1787868788.721741:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.721750:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721756:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868788.721777:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6de2981 reply state 00000000ea4a90b2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721785:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.721791:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93daafdb5200) 00010000:00010000:2.0:1787868788.721794:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868788.721796:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787868788.721900:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+15:12207:x1874715918543104:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 9267us (9904us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787868788.721911:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:3.0:1787868788.789897:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868788.790295:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543360 00000100:00100000:0.0:1787868788.790309:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543360 00000100:00100000:0.0:1787868788.790399:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:0.0:1787868788.790412:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+15:12215:x1874715918543360:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:0.0:1787868788.790449:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868788.790480:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff158 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790575:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790593:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790608:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868788.790668:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868788.790674:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868788.790703:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790734:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2da72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff158 expref: 17 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790755:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff158 expref: 16 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868788.790783:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:0.0:1787868788.790787:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868788.790791:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286400, rc 0) 00000100:00100000:0.0:1787868788.790887:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+16:12215:x1874715918543360:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 477us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868788.790896:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 155 00010000:00010000:3.0:1787868788.834914:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868788.874151:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.874291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543488 00000100:00100000:2.0:1787868788.874315:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543488 00000100:00100000:2.0:1787868788.874408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:2.0:1787868788.874423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+16:12221:x1874715918543488:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868788.874454:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868788.874481:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2da80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff15f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874565:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874596:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874650:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874874:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874886:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874972:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874982:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.874988:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868788.875026:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787868788.875031:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868788.875058:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875073:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875081:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875099:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875106:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.875111:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875118:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875133:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:2.0:1787868788.875136:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.875142:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875149:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2da87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875197:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875204:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875209:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875214:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.875217:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875232:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875243:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93daafdb5200) 00010000:00010000:2.0:1787868788.875245:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.875248:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875254:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2da8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875296:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2da80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff15f expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875332:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff15f expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.875341:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868788.875343:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787868788.875345:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030800, rc 0) 00000100:00100000:2.0:1787868788.875478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+17:12221:x1874715918543488:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1058us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868788.875488:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:0.0:1787868788.885845:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.885948:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543744 00000100:00100000:2.0:1787868788.885959:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543744 00000100:00100000:2.0:1787868788.886023:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:2.0:1787868788.886034:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+17:12221:x1874715918543744:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868788.886075:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868788.886097:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2da9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff166 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886247:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886263:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886276:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886333:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886341:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886349:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787868788.886732:0:13805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787868788.886888:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886898:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886906:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886951:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886958:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886964:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886970:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868788.886974:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886982:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.886995:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868788.886998:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868788.887003:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.887009:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2daa3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868788.887021:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081c88d53 reply state 00000000b03271c8 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.887033:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.887039:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:2.0:1787868788.887047:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868788.887050:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787868788.887083:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2da9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.887098:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.887105:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:2.0:1787868788.887108:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868788.887110:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031000, rc 0) 00000100:00100000:2.0:1787868788.887226:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+20:12221:x1874715918543744:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1194us (1392us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787868788.887235:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:0.0:1787868788.892138:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868788.892294:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918543872 00000100:00100000:1.0:1787868788.892304:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918543872 00000100:00100000:1.0:1787868788.892371:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1787868788.892382:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2404:x1874715918543872:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1787868788.892400:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868788.892421:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff16d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868788.892445:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868788.892466:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1787868788.892485:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868788.892497:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868788.892527:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868788.892543:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1800, rc 0) 00000100:00100000:1.0:1787868788.892617:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918543872:12345-192.168.204.27@tcp:101:bash.0 Request processed in 237us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868788.892625:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1787868788.899997:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.900222:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918544000 00000100:00100000:2.0:1787868788.900236:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918544000 00000100:00100000:2.0:1787868788.900315:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1787868788.900328:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+6:12221:x1874715918544000:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868788.900352:0:8962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868788.900377:0:8962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff174 expref: -99 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.900421:0:8962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.900433:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868788.900438:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868788.900444:0:8962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.900507:0:8962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.900525:0:8962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868788.900543:0:8962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8962:1874715939590144:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868788.900666:0:8962:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868788.904238:0:8962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8962:1874715939590144:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868788.904276:0:8962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 7 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.904297:0:8962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030a00, rc 0) 00000100:00100000:2.0:1787868788.904361:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:12221:x1874715918544000:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4035us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868788.904371:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1787868788.910531:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.910842:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918544128 00000100:00100000:2.0:1787868788.910875:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918544128 00010000:00010000:2.0:1787868788.910935:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868788.910986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:2.0:1787868788.910996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918544128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868788.911032:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868788.911056:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.911072:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.911097:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2dabf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff16d expref: 7 pid: 8430 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.911115:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868788.911120:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868788.911128:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.911140:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868788.911235:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868788.911252:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874715939590272:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787868788.911354:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868788.914867:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988384f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874715939590272:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787868788.914897:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868788.914988:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918544128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3992us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868788.915001:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1787868788.917570:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868788.917854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918544384 00000100:00100000:2.0:1787868788.917882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918544384 00000100:00100000:2.0:1787868788.917963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:2.0:1787868788.917974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+20:12221:x1874715918544384:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1787868788.918342:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+21:12221:x1874715918544384:12345-192.168.204.27@tcp:35:bash.0 Request processed in 369us (844us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787868788.918350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787868789.034517:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.034742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918544640 00000100:00100000:3.0:1787868789.034759:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918544640 00000100:00100000:3.0:1787868789.034868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:3.0:1787868789.034882:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+21:12231:x1874715918544640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868789.034918:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868789.035126:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dacd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff17b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868789.035341:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787868789.035478:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dacd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff17b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.035683:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:3.0:1787868789.035704:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868789.035711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dacd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff17b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.035735:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:3.0:1787868789.036369:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:12231:x1874715918544640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1487us (1875us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1787868789.036382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:0.0:1787868789.044362:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.044762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918544896 00000100:00100000:2.0:1787868789.044778:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918544896 00000100:00100000:2.0:1787868789.044889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1787868789.044901:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+22:12231:x1874715918544896:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868789.045648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+23:12231:x1874715918544896:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 745us (1297us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787868789.045660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:0.0:1787868789.131355:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.132558:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545024 00000100:00100000:2.0:1787868789.132579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545024 00000100:00100000:2.0:1787868789.132696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:2.0:1787868789.132713:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+23:12237:x1874715918545024:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868789.132754:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868789.133019:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2dadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff182 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.133125:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.133207:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.136033:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868789.136138:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787868789.136144:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868789.136193:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.136258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2dadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff182 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.136292:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff182 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.136303:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868789.136307:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868789.136312:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868789.136432:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:12237:x1874715918545024:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3722us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868789.136444:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:0.0:1787868789.144581:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.144689:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545280 00000100:00100000:2.0:1787868789.144707:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545280 00000100:00100000:2.0:1787868789.144794:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1787868789.144808:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+24:12237:x1874715918545280:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868789.144841:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868789.144909:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff189 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.145077:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2daf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.145097:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2daf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.145115:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2daf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868789.145131:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787868789.145580:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff189 expref: 27 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.145602:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2daf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff189 expref: 26 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.145612:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:2.0:1787868789.145616:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868789.145621:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870c00, rc 0) 00000100:00100000:2.0:1787868789.145831:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+26:12237:x1874715918545280:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1025us (1266us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787868789.145841:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1787868789.157494:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868789.157554:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.157641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545664 00000100:00100000:2.0:1787868789.157656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545664 00000100:00100000:3.0:1787868789.157715:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545408 00000100:00100000:3.0:1787868789.157721:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545408 00000100:00100000:2.0:1787868789.157743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:2.0:1787868789.157760:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+27:12237:x1874715918545664:12345-192.168.204.27@tcp:101:lfs.0 00000100:00100000:3.0:1787868789.157782:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787868789.157797:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+27:2406:x1874715918545408:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868789.157814:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868789.157816:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868789.157840:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dafe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.157849:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2daf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff189 expref: 27 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.157886:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:3.0:1787868789.157894:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868789.158007:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.158023:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.158036:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868789.158050:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:3.0:1787868789.158229:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+29:2406:x1874715918545408:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 434us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868789.158240:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:2.0:1787868789.158539:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dafe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff190 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.158559:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff190 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.158569:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:2.0:1787868789.158572:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787868789.158575:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871800, rc 0) 00000100:00100000:2.0:1787868789.158618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+27:12237:x1874715918545664:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 865us (1064us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787868789.158626:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:1.0:1787868789.167499:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.171194:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545792 00000100:00100000:3.0:1787868789.171223:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545792 00000100:00100000:3.0:1787868789.171356:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787868789.171370:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+6:2403:x1874715918545792:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:3.0:1787868789.171438:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.171494:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.171506:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868789.171512:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868789.171518:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.171592:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.171611:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 6 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868789.171633:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1874715939590400:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868789.171794:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da989750c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787868789.171923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868789.175152:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.175490:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1874715939590400:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868789.175526:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868789.176146:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918545920 00000100:00100000:1.0:1787868789.176249:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918545920 00002000:00100000:1.0:1787868789.176327:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93d9889b0b40 x1874715918545920/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:110/0 lens 504/0 e 0 to 0 dl 1787868800 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868789.176340:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9889b0b40 with x1874715918545920 ext(0->12) 00010000:00010000:1.0:1787868789.176349:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 7 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.176366:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 7 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868789.176375:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d9889b0b40 00000100:00100000:1.0:1787868789.176457:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1787868789.176470:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918545920:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:1.0:1787868789.180372:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918545920:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 3883us (5216us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787868789.180391:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:1.0:1787868789.180411:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93d9889b0b40 x1874715918545920/t4294967306(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:110/0 lens 504/448 e 0 to 0 dl 1787868800 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787868789.180424:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9889b0b40 with x1874715918545920 ext(0->12) 00010000:00010000:1.0:1787868789.180438:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.180462:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787868789.180471:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d9889b0b40 00000100:00100000:0.0:1787868789.188056:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868789.188268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918546048 00000100:00100000:1.0:1787868789.188281:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918546048 00010000:00010000:0.0:1787868789.188572:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868789.188632:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1787868789.188646:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918546048:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868789.188691:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787868789.188719:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787868789.188724:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787868788 00002000:00010000:0.0:1787868789.188726:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787868788 00002000:00010000:0.0:1787868789.188729:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787868788 00002000:00010000:0.0:1787868789.188732:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787868789.188739:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.188754:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.188787:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2dac6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff174 expref: 9 pid: 8962 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.188813:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868789.188819:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868789.188828:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.188840:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.188898:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868789.189107:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918546048:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 462us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868789.189119:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00010000:00010000:3.0:1787868789.189382:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189395:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189429:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189437:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189444:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189451:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868789.189456:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189464:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189479:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.189486:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5693c29/0x2f11f4d3bde2db13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868789.189561:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918545792:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 18194us (22076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868789.189571:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1787868789.199328:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.199463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918546304 00000100:00100000:2.0:1787868789.199478:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918546304 00000100:00100000:2.0:1787868789.199558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1787868789.199590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e35450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+27:12237:x1874715918546304:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:2.0:1787868789.199685:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff190 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787868789.199967:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787868789.200004:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787868789.205848:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787868789.206100:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.206258:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 31 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.206272:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.206335:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 31 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.206358:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 31 pid: 13805 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868789.206378:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939590528:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868789.206555:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868789.214289:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874715939590528:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868789.214340:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868789.214347:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868789.214609:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918546432 00000100:00100000:1.0:1787868789.214619:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918546432 00010000:00010000:1.0:1787868789.214675:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 32 pid: 13805 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868789.214774:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:1.0:1787868789.214787:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+32:2404:x1874715918546432:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868789.214808:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868789.214817:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 32 pid: 13805 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214876:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 32 pid: 13805 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214908:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2dab1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff166 expref: 32 pid: 13805 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214930:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:1.0:1787868789.214936:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214948:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214958:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.214999:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868789.215082:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+31:2404:x1874715918546432:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 297us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868789.215092:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00010000:00010000:0.0:1787868789.215186:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.215195:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787868789.215348:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1787868789.215518:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787868789.215632:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939590656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787868789.215702:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868789.215745:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99fcab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868789.215846:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939590656 00000100:00100000:2.0:1787868789.215866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939590656 00000100:00100000:2.0:1787868789.215956:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787868789.215967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939590656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787868789.216071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939590656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868789.216078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1787868789.216277:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868789.216321:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939590656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787868789.216489:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1787868789.216547:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939590784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787868789.216583:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868789.216608:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868789.216877:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939590784 00000100:00100000:3.0:1787868789.216884:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939590784 00000100:00100000:3.0:1787868789.217128:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787868789.217272:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874715939590784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787868789.217450:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1874715939590784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 183us (865us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787868789.217458:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787868789.217761:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874715939590784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787868789.217831:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1787868789.218063:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218076:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218086:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218093:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868789.218101:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218112:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218144:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:0.0:1787868789.218201:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787868789.218209:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.218217:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868789.218353:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787868789.218442:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787868789.218456:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413344299037ns, next at 414344296329ns, rc = 0 00000001:00080000:0.0:1787868789.218464:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1787868789.218491:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5000) 00010000:00010000:0.0:1787868789.218494:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787868789.218503:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff190 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868789.218655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e35450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+34:12237:x1874715918546304:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 19067us (19343us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1787868789.218666:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000020:00080000:0.0:1787868789.218672:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787868789.221661:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.221821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918546560 00000100:00100000:2.0:1787868789.221834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918546560 00000100:00100000:2.0:1787868789.221925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:2.0:1787868789.221939:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+34:12237:x1874715918546560:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868789.221983:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868789.222021:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2db21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff197 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.222118:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2db21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff197 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.222139:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2db21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff197 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.222215:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868789.222219:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868789.222225:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868789.222315:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+35:12237:x1874715918546560:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 379us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868789.222324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:1.0:1787868789.229765:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.229992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918546816 00000100:00100000:2.0:1787868789.230006:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918546816 00000100:00100000:2.0:1787868789.230088:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1787868789.230103:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+35:12237:x1874715918546816:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868789.230501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+36:12237:x1874715918546816:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 400us (751us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787868789.230510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1787868789.378543:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.379317:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918547072 00000100:00100000:2.0:1787868789.379334:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918547072 00000100:00100000:3.0:1787868789.379556:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1787868789.379571:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+36:12247:x1874715918547072:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868789.379608:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868789.379636:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2db28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff19e expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868789.379772:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787868789.380105:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2db28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff19e expref: 38 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.380128:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:3.0:1787868789.380132:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868789.380139:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2db28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff19e expref: 38 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.380194:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:3.0:1787868789.380288:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+37:12247:x1874715918547072:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 721us (1760us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787868789.380317:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1787868789.385717:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.385903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918547200 00000100:00100000:2.0:1787868789.385919:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918547200 00000100:00100000:2.0:1787868789.386010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:2.0:1787868789.386023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+37:12247:x1874715918547200:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868789.386143:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386196:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386211:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386245:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386259:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386359:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386369:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386376:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868789.386443:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386459:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386466:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386474:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386479:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868789.386484:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386499:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386515:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868789.386518:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868789.386524:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386530:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2db36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386549:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386555:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386561:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386567:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868789.386570:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386576:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386582:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:2.0:1787868789.386585:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868789.386588:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386603:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2db3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386614:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386621:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386628:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386632:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868789.386636:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386642:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386650:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868789.386653:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868789.386656:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.386662:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2db44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868789.386760:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+37:12247:x1874715918547200:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 738us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868789.386769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:1.0:1787868789.394874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.395016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918547456 00000100:00100000:2.0:1787868789.395030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918547456 00000100:00100000:2.0:1787868789.395111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868789.395124:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+37:12247:x1874715918547456:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868789.395858:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+38:12247:x1874715918547456:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 721us (994us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787868789.395872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1787868789.429985:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868789.430220:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918547712 00000100:00100000:0.0:1787868789.430233:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918547712 00000100:00100000:0.0:1787868789.430314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:0.0:1787868789.430327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+38:12250:x1874715918547712:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868789.430363:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868789.430389:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1a5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430491:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430529:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430545:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430560:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430569:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430576:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430730:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430741:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430748:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868789.430760:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787868789.430880:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430889:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430897:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430910:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868789.430916:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430924:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430938:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868789.430941:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868789.430959:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430966:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2db52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430982:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430988:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.430994:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431000:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868789.431002:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431009:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431028:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:0.0:1787868789.431030:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868789.431034:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431040:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431089:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431106:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.431114:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868789.431116:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868789.431119:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868789.431548:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+40:12250:x1874715918547712:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1221us (1576us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787868789.431559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1787868789.435302:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868789.435510:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918547840 00000100:00100000:0.0:1787868789.435528:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918547840 00000100:00100000:0.0:1787868789.435630:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:0.0:1787868789.435642:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+40:12250:x1874715918547840:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1787868789.435750:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435774:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435821:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435883:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435890:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435898:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435904:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868789.435909:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435917:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435951:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868789.435954:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868789.435960:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.435967:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2db6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868789.436066:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+40:12250:x1874715918547840:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 427us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868789.436076:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:1.0:1787868789.439020:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868789.439116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918548096 00000100:00100000:0.0:1787868789.439140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918548096 00000100:00100000:0.0:1787868789.439236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1787868789.439249:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+40:12250:x1874715918548096:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868789.439569:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+41:12250:x1874715918548096:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 322us (563us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787868789.439577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1787868789.751548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868789.751686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918548352 00000100:00100000:1.0:1787868789.751702:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918548352 00000100:00100000:1.0:1787868789.751825:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:1.0:1787868789.751838:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+41:12281:x1874715918548352:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:1.0:1787868789.751921:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868789.751967:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2db75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1ac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.752113:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2db7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.752132:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2db7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.752148:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2db7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868789.752200:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787868789.752347:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2db75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ac expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.752376:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2db7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ac expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.752386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868789.752389:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868789.752393:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1a00, rc 0) 00000100:00100000:1.0:1787868789.752481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+43:12281:x1874715918548352:12345-192.168.204.27@tcp:101:cat.0 Request processed in 645us (950us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787868789.752489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787868789.761580:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.761637:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868789.761740:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918548736 00000100:00100000:2.0:1787868789.761755:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918548736 00000100:00100000:0.0:1787868789.761837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918548608 00000100:00100000:2.0:1787868789.761858:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1787868789.761871:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+43:2404:x1874715918548736:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868789.761891:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868789.761947:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2db7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ac expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868789.761987:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868789.761992:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868789.762006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918548608 00000100:00100000:2.0:1787868789.762073:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+43:2404:x1874715918548736:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 204us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868789.762083:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1787868789.762585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:0.0:1787868789.762602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+42:12281:x1874715918548608:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:0.0:1787868789.763518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+43:12281:x1874715918548608:12345-192.168.204.27@tcp:35:cat.0 Request processed in 917us (1948us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787868789.763529:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00010000:00010000:3.0:1787868789.857993:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868789.862410:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868789.862595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918548992 00000100:00100000:0.0:1787868789.862608:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918548992 00000100:00100000:0.0:1787868789.862691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:0.0:1787868789.862703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+43:12287:x1874715918548992:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1787868789.862738:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868789.862742:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787868789.862776:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff182 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863025:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868789.863032:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868789.863051:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db8a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863374:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863383:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863426:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.863443:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 43 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868789.863460:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939590912:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868789.863759:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868789.871655:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939590912:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868789.871704:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868789.871959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.874515:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918549120 00000100:00100000:3.0:1787868789.874540:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918549120 00010000:00010000:3.0:1787868789.874610:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 44 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868789.874676:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:3.0:1787868789.874688:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+44:2404:x1874715918549120:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868789.874710:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868789.874718:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 44 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.874735:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 44 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.874763:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2db60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1a5 expref: 44 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.874785:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868789.874813:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.874825:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.874836:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.875032:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868789.875259:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+43:2404:x1874715918549120:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 572us (3300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868789.875269:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00010000:00010000:0.0:1787868789.877717:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.877737:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868789.877770:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787868789.878282:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2db8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.878312:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868789.878322:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868789.878326:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787868789.878331:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868789.878431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+43:12287:x1874715918548992:12345-192.168.204.27@tcp:101:dd.0 Request processed in 15729us (16035us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787868789.878442:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:2.0:1787868789.885330:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868789.885998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918549248 00000100:00100000:3.0:1787868789.886013:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918549248 00000100:00100000:3.0:1787868789.886097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:3.0:1787868789.886110:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+43:12287:x1874715918549248:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1787868789.886143:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868789.886200:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2db9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886247:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886265:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886282:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886451:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2db9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886483:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868789.886492:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868789.886496:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868789.886500:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:3.0:1787868789.886701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+44:12287:x1874715918549248:12345-192.168.204.27@tcp:101:dd.0 Request processed in 592us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868789.886710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:0.0:1787868789.889716:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868789.889822:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918549504 00000100:00100000:1.0:1787868789.889836:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918549504 00000100:00100000:1.0:1787868789.889930:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:1.0:1787868789.889961:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+44:12287:x1874715918549504:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:1.0:1787868789.890333:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.890356:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.890370:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868789.890424:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787868789.890451:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf4f2ba reply state 0000000088c790ad transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.890466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868789.890474:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868789.890478:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868789.890483:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868789.890605:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+47:12287:x1874715918549504:12345-192.168.204.27@tcp:36:dd.0 Request processed in 646us (902us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787868789.890613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 170 00000020:00080000:1.0:1787868789.890619:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787868790.177395:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.177562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918549632 00000100:00100000:0.0:1787868790.177583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918549632 00000100:00100000:0.0:1787868790.177662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:0.0:1787868790.177674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+47:12301:x1874715918549632:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:0.0:1787868790.177703:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868790.177727:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dbb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1c1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177799:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177813:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177824:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177878:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177886:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177894:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177969:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177979:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.177988:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.178023:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.178049:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 48 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868790.178064:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939591040:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868790.178223:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6000 going to sleep for 11 seconds 00000100:00080000:2.0:1787868790.178786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868790.182228:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.182444:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939591040:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868790.182488:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868790.183015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918549888 00000100:00100000:2.0:1787868790.183029:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918549888 00000100:00100000:2.0:1787868790.183114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1787868790.183141:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+49:6177:x1874715918549888:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787868790.183504:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+50:6177:x1874715918549888:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 366us (1291us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787868790.183512:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1787868790.190647:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868790.190848:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918550016 00000100:00100000:2.0:1787868790.190876:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918550016 00010000:00010000:2.0:1787868790.191295:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 50 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868790.191407:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:2.0:1787868790.191419:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+50:2404:x1874715918550016:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868790.191440:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868790.191448:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 50 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191465:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 50 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191494:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2db91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1b3 expref: 50 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191514:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868790.191519:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191532:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191562:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.191600:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868790.191682:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+49:2404:x1874715918550016:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 265us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868790.191691:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00010000:00010000:1.0:1787868790.193905:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194090:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868790.194279:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787868790.194286:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868790.194322:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194345:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194358:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194365:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194372:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194379:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868790.194383:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194392:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194412:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868790.194416:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868790.194422:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194440:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dbbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194460:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194467:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194472:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194476:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868790.194479:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194486:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194495:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:1.0:1787868790.194498:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868790.194501:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194507:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dbc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194560:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dbb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c1 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194664:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c1 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.194680:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868790.194682:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868790.194686:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:1.0:1787868790.195028:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+48:12301:x1874715918549632:12345-192.168.204.27@tcp:101:stat.0 Request processed in 17353us (17639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868790.195040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:1.0:1787868790.284480:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868790.284601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918550272 00000100:00100000:3.0:1787868790.284615:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918550272 00000100:00100000:3.0:1787868790.284697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:3.0:1787868790.284711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+48:12307:x1874715918550272:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:3.0:1787868790.284803:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868790.284857:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c1 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868790.284884:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868790.284891:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868790.285148:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868790.285232:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868790.285245:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868790.285320:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1787868790.285348:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cf99596 reply state 00000000e1c9bf20 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868790.285363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868790.285370:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868790.285374:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868790.285377:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868790.285515:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+50:12307:x1874715918550272:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 806us (1049us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787868790.285524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 172 00000020:00080000:3.0:1787868790.285530:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787868790.446740:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.446974:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918550400 00000100:00100000:0.0:1787868790.446987:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918550400 00000100:00100000:0.0:1787868790.447099:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:0.0:1787868790.447112:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+50:12321:x1874715918550400:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:0.0:1787868790.447147:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868790.447208:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dbd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1c8 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447316:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447335:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447348:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447360:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447367:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447373:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447466:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447477:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447484:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868790.447547:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787868790.447552:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868790.447583:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447598:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447607:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447613:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447620:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447626:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868790.447631:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447638:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447653:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868790.447656:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868790.447661:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447668:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dbde lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447694:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447701:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447707:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447712:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868790.447715:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447721:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447729:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:0.0:1787868790.447731:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868790.447734:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.447740:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dbe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.448318:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dbd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 52 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.448347:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 51 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.448368:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868790.448371:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868790.448373:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787868790.448477:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+51:12321:x1874715918550400:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1366us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868790.448488:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:0.0:1787868790.551360:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.551467:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918550656 00000100:00100000:1.0:1787868790.551487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918550656 00000100:00100000:1.0:1787868790.551578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:1.0:1787868790.551591:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+51:12332:x1874715918550656:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868790.551620:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868790.551649:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2dbf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1cf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868790.551808:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787868790.552151:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2dbf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1cf expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.552210:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:1.0:1787868790.552213:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868790.552220:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2dbf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1cf expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.552247:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1e00, rc 0) 00000100:00100000:1.0:1787868790.552341:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+52:12332:x1874715918550656:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 751us (991us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1787868790.552371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:1.0:1787868790.559728:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868790.559858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918550912 00000100:00100000:2.0:1787868790.559873:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918550912 00000100:00100000:2.0:1787868790.559962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1787868790.559975:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e37450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+52:12332:x1874715918550912:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868790.560338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e37450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+53:12332:x1874715918550912:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 364us (622us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787868790.560347:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1787868790.636043:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.636221:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918551168 00000100:00100000:1.0:1787868790.636237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918551168 00000100:00100000:1.0:1787868790.636318:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:1.0:1787868790.636331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+53:12338:x1874715918551168:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1787868790.636367:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868790.636405:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2dc01 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.636554:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.636573:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 54 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.636585:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.636627:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 54 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.636644:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 54 pid: 10190 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868790.636663:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939591168:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868790.636798:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868790.658604:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.658810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918551296 00000100:00100000:0.0:1787868790.658836:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918551296 00010000:00010000:0.0:1787868790.658893:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 55 pid: 10190 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868790.659212:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939591168:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868790.659249:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868790.659455:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:0.0:1787868790.659469:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+55:2404:x1874715918551296:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868790.659490:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868790.659499:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 55 pid: 10190 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659514:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 55 pid: 10190 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659545:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dbec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1c8 expref: 55 pid: 10190 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659564:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868790.659589:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659602:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659612:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.659646:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868790.659722:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+54:2404:x1874715918551296:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 256us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868790.659731:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00010000:00010000:1.0:1787868790.659796:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.659804:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868790.659840:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787868790.660032:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2dc01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.660061:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.660940:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868790.660946:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787868790.660950:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1400, rc 0) 00000100:00100000:1.0:1787868790.661023:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+54:12338:x1874715918551168:12345-192.168.204.27@tcp:101:bash.0 Request processed in 24692us (24994us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787868790.661032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:3.0:1787868790.667302:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.667434:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918551552 00000100:00100000:1.0:1787868790.667448:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918551552 00000100:00100000:1.0:1787868790.667530:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:1.0:1787868790.667544:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+54:12338:x1874715918551552:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1787868790.667908:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.667965:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.667982:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868790.668046:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1787868790.668334:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ee3bc80 reply state 0000000029e7e1fc transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.668350:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.668359:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868790.668363:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868790.668368:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868790.668512:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+57:12338:x1874715918551552:12345-192.168.204.27@tcp:36:bash.0 Request processed in 969us (1223us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787868790.668522:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00000020:00080000:1.0:1787868790.668528:0:10190:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787868790.681113:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.681272:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918551680 00000100:00100000:0.0:1787868790.681288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918551680 00000100:00100000:0.0:1787868790.681365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:0.0:1787868790.681376:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+57:12338:x1874715918551680:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868790.681417:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868790.681443:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.681569:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.681587:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.681598:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.681664:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.681680:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 58 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868790.681697:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939591296:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868790.681804:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868790.684617:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939591296:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868790.684660:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868790.685677:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.692165:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918551808 00000100:00100000:0.0:1787868790.692189:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918551808 00010000:00010000:1.0:1787868790.692431:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 59 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868790.692487:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:1.0:1787868790.692498:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+59:2403:x1874715918551808:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868790.692519:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868790.692526:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 59 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692567:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 59 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692599:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1d6 expref: 59 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692631:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868790.692638:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692650:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692660:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.692699:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868790.692794:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+58:2403:x1874715918551808:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 297us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868790.692803:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00010000:00010000:0.0:1787868790.692988:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.692998:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868790.693071:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787868790.693076:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868790.693105:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.693146:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1dd expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.693226:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1dd expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.693234:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868790.693237:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868790.693239:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286e00, rc 0) 00000100:00100000:0.0:1787868790.693277:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+57:12338:x1874715918551680:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11904us (12181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868790.693286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:3.0:1787868790.696965:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868790.697152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918552064 00000100:00100000:2.0:1787868790.697203:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918552064 00000100:00100000:2.0:1787868790.697279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1787868790.697292:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+57:12338:x1874715918552064:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1787868790.697621:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+58:12338:x1874715918552064:12345-192.168.204.27@tcp:35:bash.0 Request processed in 331us (672us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787868790.697630:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1787868790.800961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.801126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918552320 00000100:00100000:1.0:1787868790.801141:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918552320 00000100:00100000:1.0:1787868790.801298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:1.0:1787868790.801312:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+58:12348:x1874715918552320:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868790.801347:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868790.801375:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868790.801762:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787868790.801926:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1e4 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.801945:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:1.0:1787868790.801949:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868790.801955:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1e4 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.801981:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1400, rc 0) 00000100:00100000:1.0:1787868790.802064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+59:12348:x1874715918552320:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 755us (1122us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787868790.802072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:3.0:1787868790.809370:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868790.810212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918552448 00000100:00100000:2.0:1787868790.810229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918552448 00000100:00100000:2.0:1787868790.810311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:2.0:1787868790.810326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+59:12348:x1874715918552448:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868790.810630:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.810653:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.810668:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.810684:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.810692:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.810700:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.811337:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.811863:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.812036:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868790.812116:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.812135:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813372:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813381:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813462:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868790.813468:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813479:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813503:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868790.813507:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868790.813513:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813521:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813546:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813552:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813559:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813565:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868790.813583:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813590:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813600:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:2.0:1787868790.813603:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868790.813606:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813612:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dc40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813624:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813631:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813637:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813642:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868790.813645:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813651:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813661:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868790.813663:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868790.813673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.813680:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dc47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868790.813818:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+59:12348:x1874715918552448:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 3489us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868790.813843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:3.0:1787868790.819896:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.820131:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918552704 00000100:00100000:0.0:1787868790.820145:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918552704 00000100:00100000:0.0:1787868790.820258:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1787868790.820271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+59:12348:x1874715918552704:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868790.820759:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+60:12348:x1874715918552704:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 489us (885us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787868790.820770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00010000:00010000:0.0:1787868790.882333:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868790.888682:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868790.888942:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918552960 00000100:00100000:0.0:1787868790.888956:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918552960 00000100:00100000:0.0:1787868790.889042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:0.0:1787868790.889057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+60:12351:x1874715918552960:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868790.889440:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868790.889474:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889605:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889625:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889640:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889654:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889669:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889817:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dc63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889844:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889852:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868790.889866:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787868790.889986:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.889994:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.890009:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.890017:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868790.890022:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.890031:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.890047:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868790.890051:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868790.890056:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.890064:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dc55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896126:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896148:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896187:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896194:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868790.896845:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896891:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896954:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:0.0:1787868790.896958:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868790.896964:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.896972:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.897071:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1eb expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.897090:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dc63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1eb expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868790.897098:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868790.897101:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868790.897104:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868790.899195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+62:12351:x1874715918552960:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 10124us (10514us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787868790.899285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:3.0:1787868790.907232:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.907582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918553088 00000100:00100000:1.0:1787868790.907596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918553088 00000100:00100000:1.0:1787868790.907681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:1.0:1787868790.907693:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+62:12351:x1874715918553088:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1787868790.907789:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907811:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907842:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907899:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907932:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907939:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907945:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868790.907951:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907959:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907975:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868790.907978:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787868790.907984:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868790.907990:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2dc71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868790.908116:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+62:12351:x1874715918553088:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 424us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868790.908125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:1.0:1787868790.917653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868790.917719:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868790.917789:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918553216 00000100:00100000:2.0:1787868790.917804:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918553216 00000100:00100000:2.0:1787868790.917928:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:2.0:1787868790.917940:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+62:2404:x1874715918553216:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868790.917961:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868790.917996:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2dc63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1eb expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868790.918019:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868790.918026:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868790.918121:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+61:2404:x1874715918553216:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 183us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868790.918130:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1787868790.918904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918553472 00000100:00100000:0.0:1787868790.918914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918553472 00000100:00100000:0.0:1787868790.918997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1787868790.919007:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+61:12351:x1874715918553472:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868790.919372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+62:12351:x1874715918553472:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 366us (1651us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787868790.919380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1787868791.096670:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.097529:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918553728 00000100:00100000:2.0:1787868791.097558:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918553728 00000100:00100000:2.0:1787868791.097650:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1787868791.097664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+62:12369:x1874715918553728:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1787868791.097703:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868791.097732:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.097912:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dc7f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.097932:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dc7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.097947:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dc7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868791.097962:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787868791.099306:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dc78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f2 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.099337:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f2 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.099347:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.099351:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787868791.099355:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868791.099537:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+64:12369:x1874715918553728:12345-192.168.204.27@tcp:101:cat.0 Request processed in 1874us (2882us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787868791.099550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1787868791.136529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.136892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918553856 00000100:00100000:0.0:1787868791.136908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918553856 00000100:00100000:0.0:1787868791.137001:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:0.0:1787868791.137016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+64:12370:x1874715918553856:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868791.137051:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868791.137079:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff1f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137228:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137248:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137262:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868791.137327:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787868791.137332:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868791.137569:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137606:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f9 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137630:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f9 expref: 65 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.137663:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868791.137667:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868791.137672:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287600, rc 0) 00000100:00100000:0.0:1787868791.137864:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+65:12370:x1874715918553856:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 850us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.137874:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:1.0:1787868791.145463:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.145678:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554240 00000100:00100000:2.0:1787868791.145693:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554240 00000100:00100000:2.0:1787868791.145811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:2.0:1787868791.145838:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+65:12370:x1874715918554240:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868791.146418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+66:12370:x1874715918554240:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 572us (1047us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787868791.146432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1787868791.151770:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.151824:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554368 00000100:00100000:3.0:1787868791.151850:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554368 00000100:00100000:3.0:1787868791.151926:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868791.151938:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+66:12370:x1874715918554368:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:3.0:1787868791.151955:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787868791.151982:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2dc24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1dd expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.152007:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dc7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f2 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.152021:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2db21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff197 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.152031:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868791.152037:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868791.152095:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+63:12370:x1874715918554368:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.152104:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868791.155549:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.155698:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554496 00000100:00100000:0.0:1787868791.155719:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554496 00000100:00100000:0.0:1787868791.155830:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:0.0:1787868791.155846:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+63:12370:x1874715918554496:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:0.0:1787868791.156066:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.156093:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.156108:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868791.156277:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787868791.156402:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+63:12370:x1874715918554496:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 559us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.156412:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:1.0:1787868791.186309:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.186423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554624 00000100:00100000:2.0:1787868791.186443:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554624 00000100:00100000:2.0:1787868791.186609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:2.0:1787868791.186622:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+63:12372:x1874715918554624:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868791.186651:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868791.186679:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dca2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff200 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186802:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186833:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186848:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186860:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186868:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.186875:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187317:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187338:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187346:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868791.187406:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787868791.187411:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868791.187433:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187447:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187456:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187464:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187472:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187478:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.187484:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187492:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187505:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868791.187508:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868791.187519:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187527:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dca9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187545:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187551:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187557:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187563:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.187565:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187571:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187578:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:2.0:1787868791.187580:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868791.187583:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187588:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2dcb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187622:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dca2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187646:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.187654:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.187657:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868791.187660:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870c00, rc 0) 00000100:00100000:2.0:1787868791.187754:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+64:12372:x1874715918554624:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1135us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868791.187763:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000040:00080000:1.0:1787868791.586824:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787868791.586841:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787868791.586877:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787868791.586884:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787868791.587026:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a3c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939591424:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787868791.587612:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7eff00 going to sleep for 11 seconds 00000001:00080000:0.0:1787868791.589686:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1787868791.589758:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787868791.589785:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93dabc0c6f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787868791.589790:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab6f26000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93dabc0c69c0 00000020:00080000:0.0:1787868791.589816:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab6f26c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d987ee8a00 00000100:00100000:2.0:1787868791.589953:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868791.589974:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939591552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787868791.590039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868791.590476:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590488:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590496:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590501:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.590505:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590512:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590528:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93daafdb5200) 00010000:00010000:1.0:1787868791.590531:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.590536:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590543:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2da64 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590566:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590585:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590591:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590596:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.590598:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590603:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590612:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868791.590614:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.590617:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590622:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031e00/0x2f11f4d3bde2da6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590636:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590642:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590647:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590652:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.590661:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590668:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590676:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93daafdb5f00) 00010000:00010000:1.0:1787868791.590679:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.590682:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590686:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2daaa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590701:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590769:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590775:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590780:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.590783:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590790:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590800:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868791.590802:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.590829:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590835:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2dbad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590857:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590862:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590867:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590871:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.590874:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.590878:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591001:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868791.591004:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.591007:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591013:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dbd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591025:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591031:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591052:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591059:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.591076:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591087:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591099:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868791.591102:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868791.591106:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591113:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dc16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.591208:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939591552 00000100:00100000:1.0:1787868791.591219:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939591552 00000100:00100000:1.0:1787868791.591313:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868791.591329:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939591552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787868791.591368:0:8429:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1787868791.591408:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a90b674, atime: 0x6a90b674, ctime: 0x6a90b674, blocks: 0x8 00010000:00010000:1.0:1787868791.591415:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591429:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1787868791.591434:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868791.591446:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591462:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591470:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591477:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591495:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787868791.591660:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939591552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 336us (1620us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787868791.591668:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1787868791.591689:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868791.591695:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591703:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868791.591718:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591727:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591752:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591760:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2dcbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.591775:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868791.591777:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868791.591779:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787868791.591829:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d988387840/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787868791.591836:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939591552:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1787868791.591966:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787868791.592005:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:2.0:1787868791.592337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868791.594385:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.594795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554752 00000100:00100000:1.0:1787868791.594815:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554752 00000100:00100000:1.0:1787868791.594878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1787868791.594887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918554752:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787868791.594919:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787868791.595027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918554752:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 141us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868791.595034:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:0.0:1787868791.596335:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a3c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939591424:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787868791.600272:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.600774:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918554880 00000100:00100000:0.0:1787868791.600786:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918554880 00000100:00100000:0.0:1787868791.600863:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1787868791.600875:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+17:12383:x1874715918554880:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787868791.602481:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602504:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602517:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602532:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602540:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602547:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602575:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602584:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602603:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868791.602792:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787868791.602798:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868791.602827:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602841:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602848:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602855:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602862:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868791.602866:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602874:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.602900:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:0.0:1787868791.604393:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868791.604402:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604411:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dcc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604449:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604456:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604462:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604467:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868791.604470:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604477:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604490:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93d9870ca600) 00010000:00010000:0.0:1787868791.604493:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868791.604496:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604501:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dccc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604516:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604522:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604527:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604539:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868791.604542:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604548:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604556:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:0.0:1787868791.604558:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868791.604561:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.604568:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868791.605262:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+17:12383:x1874715918554880:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 4383us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.605274:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:1.0:1787868791.612763:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.612852:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918555136 00000100:00100000:2.0:1787868791.612863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918555136 00000100:00100000:2.0:1787868791.612922:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:2.0:1787868791.612934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+17:12383:x1874715918555136:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868791.612956:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868791.612977:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dcda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff207 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613146:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613201:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868791.613213:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787868791.613288:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613295:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613301:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613306:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.613310:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613317:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613328:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.613330:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868791.613335:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613341:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dce1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613374:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dcda lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff207 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613393:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:2.0:1787868791.613395:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868791.613398:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dcda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff207 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.613406:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868791.613456:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555136:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 525us (706us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787868791.613463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:2.0:1787868791.618411:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.618588:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918555264 00000100:00100000:3.0:1787868791.618599:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918555264 00000100:00100000:3.0:1787868791.618670:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:3.0:1787868791.618684:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555264:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787868791.618725:0:13805:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787868791.618957:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9883852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555264:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 276us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.618967:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:1.0:1787868791.636657:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.636827:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918555520 00000100:00100000:0.0:1787868791.636838:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918555520 00000100:00100000:0.0:1787868791.636885:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:0.0:1787868791.636895:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868791.636916:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868791.636919:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787868791.636943:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2dc94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1f9 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.636961:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868791.636980:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868791.636993:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff20e expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868791.637384:0:10190:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787868791.637521:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dcf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.637535:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.637561:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.637613:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2dcef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff20e expref: 20 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.637627:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff20e expref: 19 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.637634:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d9870ca600) 00010000:00010000:0.0:1787868791.637637:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868791.637639:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:0.0:1787868791.637702:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918555520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 808us (1055us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787868791.637721:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:2.0:1787868791.650363:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.650453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918555776 00000100:00100000:3.0:1787868791.650463:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918555776 00000100:00100000:3.0:1787868791.650548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:3.0:1787868791.650559:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918555776:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.650613:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868791.650650:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2dcf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff20e expref: 19 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650666:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d9870ca600) 00010000:00010000:3.0:1787868791.650676:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868791.650698:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650713:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650723:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650737:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650744:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650762:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650832:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650840:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650847:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650852:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868791.650856:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650865:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650873:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868791.650876:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868791.650879:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650885:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.650894:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651260:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651270:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651281:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868791.651284:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651291:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651300:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd23b9189 (ffff93da82a4df00) 00010000:00010000:3.0:1787868791.651303:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868791.651306:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.651312:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd23b9189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.651398:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555776:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 840us (1044us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787868791.651406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:3.0:1787868791.654699:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.654872:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918555904 00000100:00100000:3.0:1787868791.654881:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918555904 00000100:00100000:3.0:1787868791.654991:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1787868791.655000:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+18:12383:x1874715918555904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.655021:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868791.655041:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff215 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655346:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655366:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655378:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655477:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655494:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.655503:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.655506:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868791.655510:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828de00, rc 0) 00000100:00100000:3.0:1787868791.655598:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918555904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 599us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.655606:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:2.0:1787868791.659151:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.660351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918556160 00000100:00100000:1.0:1787868791.660363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918556160 00000100:00100000:1.0:1787868791.660421:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:1.0:1787868791.660438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918556160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787868791.660517:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.660535:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.660702:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868791.660951:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787868791.660961:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415786804389ns, next at 416786802019ns, rc = 0 00000004:00010000:1.0:1787868791.661009:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec1c5ddf reply state 0000000023556791 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.661023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.661030:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868791.661032:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787868791.661036:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868791.661140:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+21:12383:x1874715918556160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 704us (1999us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787868791.661148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:2.0:1787868791.665478:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.669024:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918556288 00000100:00100000:3.0:1787868791.669039:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918556288 00000100:00100000:3.0:1787868791.669114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:3.0:1787868791.669125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+21:12383:x1874715918556288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.669149:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868791.669182:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff21c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.669237:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.669260:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.669277:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.669281:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868791.669284:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c200, rc 0) 00000100:00100000:3.0:1787868791.669342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+22:12383:x1874715918556288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 221us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.669350:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:2.0:1787868791.674209:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.674579:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918556416 00000100:00100000:1.0:1787868791.674590:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918556416 00000100:00100000:1.0:1787868791.674673:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1787868791.674689:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+6:2404:x1874715918556416:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787868791.674786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868791.675071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918556416:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 387us (869us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787868791.675093:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1787868791.679239:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.679329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918556672 00000100:00100000:2.0:1787868791.679339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918556672 00000100:00100000:2.0:1787868791.679429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1787868791.679440:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+22:12383:x1874715918556672:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787868791.679827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+23:12383:x1874715918556672:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 386us (775us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787868791.679837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1787868791.684530:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.684699:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918556928 00000100:00100000:0.0:1787868791.684709:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918556928 00000100:00100000:0.0:1787868791.684878:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1787868791.684890:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+23:12383:x1874715918556928:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787868791.685033:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+23:12383:x1874715918556928:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 146us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.685042:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1787868791.700671:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.701021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557056 00000100:00100000:3.0:1787868791.701032:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557056 00000100:00100000:3.0:1787868791.701093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:3.0:1787868791.701104:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+23:12383:x1874715918557056:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.701127:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868791.701147:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff223 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701239:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701254:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701266:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868791.701328:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868791.701347:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701373:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff223 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701389:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff223 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.701399:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.701402:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787868791.701406:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d400, rc 0) 00000100:00100000:3.0:1787868791.701469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+24:12383:x1874715918557056:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 367us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.701477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:3.0:1787868791.708633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.708668:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557184 00000100:00100000:3.0:1787868791.708678:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557184 00000100:00100000:3.0:1787868791.708728:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1787868791.708737:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918557184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.708758:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868791.708778:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff22a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787868791.708815:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b677, blocks: 0x0 00010000:00010000:3.0:1787868791.708848:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787868791.708853:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868791.708863:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.708881:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.708895:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c400, rc 0) 00000100:00100000:3.0:1787868791.708949:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918557184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 213us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.708956:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1787868791.718674:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.718743:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557440 00000100:00100000:0.0:1787868791.718761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557440 00000100:00100000:0.0:1787868791.718827:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:0.0:1787868791.718837:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:12383:x1874715918557440:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787868791.718957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:12383:x1874715918557440:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.718965:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:3.0:1787868791.722193:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.722495:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557568 00000100:00100000:1.0:1787868791.722505:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557568 00000100:00100000:1.0:1787868791.722665:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1787868791.722678:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:12383:x1874715918557568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787868791.722699:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868791.722718:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff231 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.722751:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.722758:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868791.722762:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868791.722766:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.722795:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.722824:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.722839:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939591680:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868791.722996:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868791.725647:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.725719:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557696 00000100:00100000:2.0:1787868791.725740:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557696 00010000:00010000:2.0:1787868791.725790:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 10 pid: 8429 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.725832:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939591680:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868791.725865:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.725897:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1c00, rc 0) 00000100:00100000:1.0:1787868791.725952:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+10:12383:x1874715918557568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 3277us (3803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868791.725968:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1787868791.726002:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1787868791.726014:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+9:2404:x1874715918557696:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868791.726029:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868791.726053:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.726067:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.726093:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3aa6b41/0x2f11f4d3bde2dd3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff22a expref: 9 pid: 8429 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.726113:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868791.726117:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868791.726127:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.726139:0:7463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.726198:0:7463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868791.726227:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7463:1874715939591808:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787868791.726284:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91620c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868791.729105:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7463:1874715939591808:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787868791.729131:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868791.729205:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918557696:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3192us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868791.729216:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:3.0:1787868791.733587:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.733690:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557824 00000100:00100000:0.0:1787868791.733703:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557824 00002000:00100000:0.0:1787868791.733767:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93d9889e4f00 x1874715918557824/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:112/0 lens 504/0 e 0 to 0 dl 1787868802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868791.733781:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9889e4f00 with x1874715918557824 ext(0->8) 00002000:00010000:0.0:1787868791.733787:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9889e4f00 00000100:00100000:0.0:1787868791.733830:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868791.733841:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918557824:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787868791.735294:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+10:2403:x1874715918557824:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 1447us (1710us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787868791.735306:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00002000:00100000:0.0:1787868791.735316:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93d9889e4f00 x1874715918557824/t4294967315(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:112/0 lens 504/448 e 0 to 0 dl 1787868802 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868791.735342:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9889e4f00 with x1874715918557824 ext(0->8) 00002000:00010000:0.0:1787868791.735347:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9889e4f00 00000100:00100000:3.0:1787868791.742099:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.742475:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918557952 00000100:00100000:0.0:1787868791.742485:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918557952 00000100:00100000:0.0:1787868791.742545:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:0.0:1787868791.742556:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+24:12383:x1874715918557952:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787868791.745522:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1787868791.745540:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:1.0:1787868791.745659:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745675:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745683:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745689:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.745695:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745704:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745723:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868791.745726:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787868791.745732:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.745739:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2dd20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.746191:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939591936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787868791.746264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868791.746348:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939591936 00000100:00100000:1.0:1787868791.746355:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939591936 00000100:00100000:1.0:1787868791.746410:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787868791.746419:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939591936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787868791.746534:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787868791.746538:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787868791 00002000:00010000:1.0:1787868791.746541:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787868791.746543:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787868791 -> 1787868791 00002000:00010000:1.0:1787868791.746545:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:0.0:1787868791.746684:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1787868791.746812:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918557952:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 4246us (4710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868791.746822:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:1.0:1787868791.747101:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939591936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 682us (836us total) trans 4294967316 rc 0/0 00000004:00080000:3.0:1787868791.747108:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d98813cf00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787868791.747110:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787868791.747120:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939591936:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787868791.747133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1787868791.747142:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787868791.747177:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787868791.750794:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.751039:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558080 00000100:00100000:2.0:1787868791.751050:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558080 00000100:00100000:2.0:1787868791.751109:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1787868791.751120:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+10:2404:x1874715918558080:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787868791.753252:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1787868791.753265:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787868791.753836:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918558080:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 2711us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868791.753848:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1787868791.756669:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.756733:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558336 00000100:00100000:3.0:1787868791.756760:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558336 00000100:00100000:3.0:1787868791.756837:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:3.0:1787868791.756848:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918558336:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868791.756916:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868791.756955:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff223 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.756976:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.756982:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868791.757013:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.757028:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.757039:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868791.757212:0:13805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042c91f2f reply state 000000005e6ffa5a transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.757226:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.757233:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.757236:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868791.757239:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868791.757709:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+20:12383:x1874715918558336:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 860us (1047us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787868791.757717:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:2.0:1787868791.763491:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868791.766824:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558464 00000100:00100000:0.0:1787868791.766841:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558464 00000100:00100000:0.0:1787868791.766914:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:0.0:1787868791.766926:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918558464:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787868791.767089:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787868791.767094:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787868791 -> 1787868790 00002000:00010000:0.0:1787868791.767097:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787868788 00002000:00010000:0.0:1787868791.767099:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787868791 -> 1787868790 00002000:00010000:0.0:1787868791.767102:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787868791.767187:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918558464:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 263us (3703us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787868791.767195:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1787868791.776682:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.776780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558720 00000100:00100000:1.0:1787868791.776791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558720 00000100:00100000:1.0:1787868791.776859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:1.0:1787868791.776870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+20:12383:x1874715918558720:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787868791.776950:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.776968:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.776979:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.777013:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.777037:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 20 pid: 13805 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.777052:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939592064:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868791.777140:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868791.780510:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939592064:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868791.780545:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868791.781261:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.781378:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558848 00000100:00100000:3.0:1787868791.781385:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558848 00010000:00010000:3.0:1787868791.781420:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 21 pid: 13805 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.782835:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:3.0:1787868791.782853:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+21:2403:x1874715918558848:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868791.782871:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868791.782954:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 21 pid: 13805 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.782973:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 21 pid: 13805 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.782997:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff215 expref: 21 pid: 13805 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.783013:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:3.0:1787868791.783018:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.783029:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.783048:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.783082:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868791.783127:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783138:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.783175:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918558848:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 310us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.783185:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00010000:00010000:1.0:1787868791.783199:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783209:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783216:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783222:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868791.783227:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783235:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783245:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868791.783248:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787868791.783258:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.783265:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd51 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.783312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918558720:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 6444us (6640us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787868791.783321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:2.0:1787868791.793890:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868791.794578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918558976 00000100:00100000:2.0:1787868791.794588:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918558976 00000100:00100000:2.0:1787868791.794637:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1787868791.794647:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918558976:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787868791.794691:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.794723:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.794733:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868791.794737:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868791.794742:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.794793:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.794821:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 8 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868791.794835:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939592192:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868791.794934:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91620c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787868791.800497:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.800556:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939592192:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868791.800581:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.802240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918559104 00000100:00100000:3.0:1787868791.802252:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918559104 00010000:00010000:3.0:1787868791.802293:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.802548:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1787868791.802559:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918559104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868791.802575:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868791.802614:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.802638:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.802674:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2dd43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff231 expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.802697:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868791.802702:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868791.802715:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.802734:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.802838:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868791.802940:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918559104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 371us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.802954:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00010000:00010000:1.0:1787868791.807877:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.807964:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.807998:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808006:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808016:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808034:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868791.808038:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808047:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808067:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.808075:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3acb6fc/0x2f11f4d3bde2dd58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.808896:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918558976:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 14243us (15012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868791.808992:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1787868791.817569:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.822054:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918559360 00000100:00100000:1.0:1787868791.822071:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918559360 00000100:00100000:1.0:1787868791.822146:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:1.0:1787868791.822171:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+19:12383:x1874715918559360:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787868791.822250:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.822267:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.822289:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.822326:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.822341:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 19 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.822355:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592320:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868791.822452:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868791.828757:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.828967:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918559488 00000100:00100000:1.0:1787868791.828977:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918559488 00010000:00010000:1.0:1787868791.829016:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.829054:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:1.0:1787868791.829064:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918559488:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868791.829081:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868791.829088:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.829103:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.829126:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:1.0:1787868791.829145:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.829180:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.829189:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.829209:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868791.829487:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2dba6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff1ba expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868791.829504:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592320:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868791.829522:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829532:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829537:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829713:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829724:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829732:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829769:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868791.829782:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868791.829795:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592448:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868791.831127:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918559488:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2056us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868791.831141:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:0.0:1787868791.831292:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868791.838409:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868791.838477:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918559616 00000100:00100000:1.0:1787868791.838485:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918559616 00010000:00010000:1.0:1787868791.838524:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868791.838565:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:1.0:1787868791.838574:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918559616:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868791.838588:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868791.838596:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.838608:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.838634:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868791.838640:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.838656:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.838664:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.838684:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868791.838734:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+20:2403:x1874715918559616:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 161us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868791.838741:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00010000:00010000:2.0:1787868791.839285:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2dd27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff21c expref: 20 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868791.839303:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592448:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868791.839324:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.839333:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.839350:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787868791.839449:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787868791.839548:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787868791.839577:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787868791.839642:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10190:1874715939592576:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787868791.839690:0:10190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868791.839718:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868791.840285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939592576 00000100:00100000:3.0:1787868791.840292:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939592576 00000100:00100000:3.0:1787868791.840336:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787868791.840345:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10190:x1874715939592576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787868791.840431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10190:x1874715939592576:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868791.840438:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787868791.840580:0:10190:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787868791.840585:0:10190:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d98813cf00, transno 4294967316 00000100:00100000:3.0:1787868791.840601:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10190:1874715939592576:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787868791.840718:0:10190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787868791.840989:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10190:1874715939592704:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787868791.841022:0:10190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868791.841046:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868791.841744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939592704 00000100:00100000:1.0:1787868791.841759:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939592704 00000100:00100000:1.0:1787868791.841791:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787868791.841798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10190:x1874715939592704:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787868791.841928:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10190:x1874715939592704:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (904us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787868791.841935:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787868791.842455:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10190:1874715939592704:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787868791.842496:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842506:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842513:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842518:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.842523:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842529:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842545:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:2.0:1787868791.842548:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868791.842552:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842569:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dd66 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842589:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842594:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842599:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842604:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.842607:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842612:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842620:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.842622:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868791.842625:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842631:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2dc9b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842653:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842665:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842681:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842713:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.842726:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 22 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868791.842738:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592832:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868791.843427:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868791.853403:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.853482:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918559744 00000100:00100000:2.0:1787868791.853494:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939592832:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868791.853498:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918559744 00010000:00010000:2.0:1787868791.853523:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.853601:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 23 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.853685:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1787868791.853695:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+23:2404:x1874715918559744:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868791.853710:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868791.853717:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 23 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854028:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 23 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854054:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dcb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff200 expref: 23 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854071:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:3.0:1787868791.854076:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854087:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854096:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.854125:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868791.854147:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854178:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854191:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854198:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854205:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854219:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.854224:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854232:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854243:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.854246:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868791.854250:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.854258:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+22:2404:x1874715918559744:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 562us (863us total) trans 0 rc 0/0 00010000:00010000:2.0:1787868791.854260:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dd6d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854277:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854282:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854297:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868791.854303:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00010000:00010000:2.0:1787868791.854310:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868791.854313:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854320:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854340:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93daafdb5600) 00010000:00010000:2.0:1787868791.854343:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868791.854347:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868791.854352:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2dd5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868791.854489:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+21:12383:x1874715918559360:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 32334us (36930us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787868791.854498:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 201 00000020:00080000:2.0:1787868791.854502:0:10190:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787868791.854649:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868791.854654:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868791.855712:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787868791.855726:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787868791.860096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868791.860335:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918560000 00000100:00100000:3.0:1787868791.860346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918560000 00000100:00100000:3.0:1787868791.860440:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787868791.860452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e37850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+21:12383:x1874715918560000:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787868791.860711:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787868791.860754:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787868791.860787:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860816:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860827:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860836:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860842:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860848:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868791.860897:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787868791.860990:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e37850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+23:12383:x1874715918560000:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 540us (901us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787868791.860998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000020:00080000:3.0:1787868791.861003:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787868791.861256:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868791.861263:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.861271:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828de00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868791.861275:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.861283:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.861301:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868791.861305:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787868791.861309:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.861316:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2dd74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868791.861326:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868791.861328:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868791.861330:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868791.907935:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787868791.921814:0:14603:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787868791.921824:0:14603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787868791.921849:0:14603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787868791.921856:0:14603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787868792.064433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.064520:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918560256 00000100:00100000:3.0:1787868792.064530:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918560256 00000100:00100000:3.0:1787868792.064609:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:3.0:1787868792.064619:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+23:12393:x1874715918560256:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868792.064642:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868792.064664:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff238 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.064777:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.064792:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.064817:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868792.064828:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787868792.065303:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2dd7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff238 expref: 26 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.065320:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff238 expref: 25 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.065327:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868792.065341:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787868792.065344:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828dc00, rc 0) 00000100:00100000:3.0:1787868792.065403:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+25:12393:x1874715918560256:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 786us (976us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787868792.065410:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00080000:2.0:1787868792.067532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868792.067851:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.067925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918560384 00000100:00100000:3.0:1787868792.067935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918560384 00000100:00100000:3.0:1787868792.067991:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00100000:3.0:1787868792.068002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:12393:x1874715918560384:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1787868792.068073:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068088:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068099:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068114:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068120:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068127:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068227:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068235:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068254:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868792.068297:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068310:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068317:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068324:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068329:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.068333:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068340:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068352:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868792.068354:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.068359:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068364:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dd90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068379:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068391:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068397:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068402:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.068405:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068410:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068417:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.068420:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.068423:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068428:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2dd97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068442:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068448:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068454:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068458:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.068467:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068473:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068481:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868792.068484:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.068487:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.068493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dd9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868792.068562:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+25:12393:x1874715918560384:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 561us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.068570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00100000:0.0:1787868792.097420:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868792.097446:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939592960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868792.097522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868792.097620:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939592960 00000100:00100000:2.0:1787868792.097629:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939592960 00000100:00100000:2.0:1787868792.097687:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787868792.097698:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939592960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868792.097727:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787868792.097771:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939592960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868792.097778:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787868792.097812:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868792.098265:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939593088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868792.098298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868792.098322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868792.098327:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98902f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939593216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868792.098352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868792.105515:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593088 00000100:00100000:3.0:1787868792.105532:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593088 00000100:00100000:3.0:1787868792.105597:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787868792.105608:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939593088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868792.105646:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787868792.105732:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939593088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (7435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.105739:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787868792.106697:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939593472:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.106749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.106791:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939593984:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.106824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.106843:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939594496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.106861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.106881:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868792.106885:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939593344:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109356:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939593856:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109387:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109406:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939594368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109464:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939593728:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109520:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989055680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939594240:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109567:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787868792.109573:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939593600:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109610:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939594112:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868792.109652:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593472 00000100:00100000:1.0:1787868792.109659:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593472 00000100:00100000:1.0:1787868792.109695:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593984 00000100:00100000:1.0:1787868792.109698:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593984 00000100:00100000:1.0:1787868792.109724:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593856 00000100:00100000:1.0:1787868792.109726:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593856 00000100:00100000:1.0:1787868792.109740:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939594240 00000100:00100000:1.0:1787868792.109743:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939594240 00000100:00100000:1.0:1787868792.109753:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593600 00000100:00100000:1.0:1787868792.109755:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593600 00000100:00100000:1.0:1787868792.109765:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939594112 00000100:00100000:1.0:1787868792.109767:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939594112 00000100:00100000:1.0:1787868792.109781:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787868792.109789:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939593472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.109858:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939593472:12345-0@lo:400:kworker.0 Request processed in 69us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.109865:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787868792.109884:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787868792.109903:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939593984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.110331:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939592960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868792.110434:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939594496 00000100:00100000:0.0:1787868792.110438:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939594496 00000100:00100000:0.0:1787868792.110467:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939594368 00000100:00100000:0.0:1787868792.110470:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939594368 00000100:00100000:0.0:1787868792.110489:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787868792.110496:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868792.114268:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787868792.114297:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939593856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.116924:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939594496:12345-0@lo:400:kworker.0 Request processed in 6419us (10052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.116950:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787868792.116983:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787868792.116995:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.117044:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939594368:12345-0@lo:400:kworker.0 Request processed in 55us (7615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.117050:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787868792.117074:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593344 00000100:00100000:0.0:1787868792.117081:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593344 00000100:00100000:0.0:1787868792.117125:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787868792.117131:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939593344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.117176:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939593344:12345-0@lo:400:kworker.0 Request processed in 46us (7882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.117199:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787868792.117248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787868792.117256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939594240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.117298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939594240:12345-0@lo:400:kworker.0 Request processed in 43us (7755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.117303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787868792.117319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787868792.117325:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939593600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.117370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939593600:12345-0@lo:400:kworker.0 Request processed in 45us (7775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.117376:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787868792.117389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787868792.117396:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939594112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868792.117422:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939594112:12345-0@lo:400:kworker.0 Request processed in 27us (7792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.117427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787868792.121393:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939593984:12345-0@lo:400:kworker.0 Request processed in 11490us (14554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.121434:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787868792.121499:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593728 00000100:00100000:1.0:1787868792.121509:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593728 00000100:00100000:1.0:1787868792.121560:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787868792.121569:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939593728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.121653:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939593728:12345-0@lo:400:kworker.0 Request processed in 86us (12166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.121659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787868792.121708:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939593344:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.121726:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939594368:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.121824:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939593472:0@lo:400:kworker.0 00010000:00080000:1.0:1787868792.121841:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989057840 x1874715939593984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868792.121851:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939593984:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.121864:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939594496:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.122043:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939593600:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.122056:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939594112:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.122066:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939593728:0@lo:400:kworker.0 00010000:00080000:1.0:1787868792.122079:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989055680 x1874715939594240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868792.122087:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989055680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939594240:0@lo:400:kworker.0 00000100:00080000:1.0:1787868792.122128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868792.122134:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868792.122137:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868792.122236:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939593216 00000100:00100000:1.0:1787868792.122241:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939593216 00000100:00100000:1.0:1787868792.122270:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787868792.122276:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939593216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868792.122293:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787868792.122330:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939593216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (23976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.122336:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787868792.122368:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939593216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868792.122382:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98902c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939593088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868792.122546:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939593856:12345-0@lo:400:kworker.0 Request processed in 8264us (13157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868792.122553:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787868792.122581:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939593856:0@lo:400:kworker.0 00000100:00100000:1.0:1787868792.125518:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.125642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918560640 00000100:00100000:3.0:1787868792.125653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918560640 00000100:00100000:3.0:1787868792.125712:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:3.0:1787868792.125723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+25:12396:x1874715918560640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868792.125850:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868792.125871:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dda5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff23f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.126123:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.126137:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.126148:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.126918:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.127116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.127128:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128110:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128127:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128137:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868792.128149:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787868792.128458:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128467:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128474:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128480:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.128485:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128492:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128504:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868792.128507:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.128512:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128519:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128534:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128540:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128546:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128551:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.128562:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128568:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128577:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93da99ffb300) 00010000:00010000:3.0:1787868792.128579:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.128581:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128587:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128639:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dda5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128656:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.128663:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.128665:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868792.128667:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d400, rc 0) 00000100:00100000:3.0:1787868792.130702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+27:12396:x1874715918560640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 4969us (5182us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787868792.130716:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:2.0:1787868792.146599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.151260:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918560768 00000100:00100000:3.0:1787868792.151280:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918560768 00000100:00100000:2.0:1787868792.152151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:2.0:1787868792.152189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:12396:x1874715918560768:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1787868792.152258:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152276:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152288:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152325:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152332:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152352:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152359:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868792.152363:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152372:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152384:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:2.0:1787868792.152387:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868792.152391:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.152398:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2ddc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868792.152477:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:12396:x1874715918560768:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 292us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868792.152484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:1.0:1787868792.159232:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.159311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561024 00000100:00100000:3.0:1787868792.159321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561024 00000100:00100000:3.0:1787868792.159416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1787868792.159429:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+27:12396:x1874715918561024:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868792.159672:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+28:12396:x1874715918561024:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 246us (450us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787868792.159680:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1787868792.188519:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.188701:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561280 00000100:00100000:0.0:1787868792.188713:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561280 00000100:00100000:0.0:1787868792.188826:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:0.0:1787868792.188837:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+28:11928:x1874715918561280:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868792.188864:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.188885:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2ddcf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff246 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.189002:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.189034:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.189044:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.189080:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.189107:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 29 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.189119:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939594624:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868792.189239:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787868792.194120:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.194215:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561408 00000100:00100000:3.0:1787868792.194225:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561408 00000100:00100000:0.0:1787868792.194247:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939594624:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868792.194277:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 30 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.194278:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868792.194334:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:3.0:1787868792.194344:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+30:2404:x1874715918561408:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868792.194360:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868792.194366:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 30 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194378:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 30 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194400:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2ddba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff23f expref: 30 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194415:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.194420:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194429:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194451:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.194479:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868792.194528:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+29:2404:x1874715918561408:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 185us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.194536:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00010000:00010000:0.0:1787868792.194737:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.194746:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868792.194766:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787868792.194909:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2ddcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 30 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.194939:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 29 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.194947:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:0.0:1787868792.194950:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787868792.194952:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868792.195000:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+29:11928:x1874715918561280:12345-192.168.204.27@tcp:101:bash.0 Request processed in 6166us (6492us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787868792.195007:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:2.0:1787868792.198771:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.198841:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561536 00000100:00100000:3.0:1787868792.198851:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561536 00000100:00100000:3.0:1787868792.198912:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:3.0:1787868792.198931:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+29:11928:x1874715918561536:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868792.198954:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868792.198974:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dde4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff24d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199006:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199019:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199030:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199146:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2dde4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff24d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199202:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff24d expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.199218:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.199221:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868792.199224:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d000, rc 0) 00000100:00100000:3.0:1787868792.199284:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+30:11928:x1874715918561536:12345-192.168.204.27@tcp:101:bash.0 Request processed in 363us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.199292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:2.0:1787868792.203147:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.203336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561792 00000100:00100000:3.0:1787868792.203347:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561792 00000100:00100000:3.0:1787868792.203445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:3.0:1787868792.203457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+30:11928:x1874715918561792:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:3.0:1787868792.203760:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.203779:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.203791:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868792.203916:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787868792.203949:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9252392 reply state 000000005647b65b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.203963:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.203970:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.203973:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868792.203991:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787868792.204034:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787868792.204441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+34:11928:x1874715918561792:12345-192.168.204.27@tcp:36:bash.0 Request processed in 982us (1300us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787868792.204449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 208 00000020:00080000:3.0:1787868792.204455:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787868792.206561:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868792.206646:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918561920 00000100:00100000:2.0:1787868792.206655:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918561920 00000100:00100000:2.0:1787868792.206733:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:2.0:1787868792.206752:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+34:11928:x1874715918561920:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868792.206789:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868792.206824:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2ddf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff254 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.206878:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2ddf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff254 expref: 35 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.206893:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2ddf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff254 expref: 35 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.206911:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:2.0:1787868792.206915:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868792.206927:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868792.206983:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+35:11928:x1874715918561920:12345-192.168.204.27@tcp:101:bash.0 Request processed in 234us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868792.206990:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:2.0:1787868792.209474:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.209543:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562048 00000100:00100000:0.0:1787868792.209553:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562048 00000100:00100000:0.0:1787868792.209610:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1787868792.209620:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:11928:x1874715918562048:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868792.209636:0:8962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.209655:0:8962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff25b expref: -99 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868792.209679:0:8962:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a90b676, atime: 0x6a90b674, ctime: 0x6a90b676, blocks: 0x8 00010000:00010000:0.0:1787868792.209702:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1787868792.209707:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.209715:0:8962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 8 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.209733:0:8962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 8 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.209762:0:8962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287000, rc 0) 00000100:00100000:0.0:1787868792.209833:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+8:11928:x1874715918562048:12345-192.168.204.27@tcp:101:bash.0 Request processed in 215us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.209841:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:1.0:1787868792.212240:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.212361:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562176 00000100:00100000:0.0:1787868792.212373:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562176 00002000:00010000:0.0:1787868792.212412:0:8436:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787868792.212417:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d989057480 with x1874715918562176 ext(0->18446744073709551615) 00002000:00010000:0.0:1787868792.212431:0:8436:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d989057480. 00000100:00100000:0.0:1787868792.212466:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868792.212475:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918562176:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:0.0:1787868792.212751:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787868792.212755:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787868790 -> 1787868792 00002000:00010000:0.0:1787868792.212758:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787868788 -> 1787868788 00002000:00010000:0.0:1787868792.212760:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787868790 -> 1787868792 00002000:00010000:0.0:1787868792.212762:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787868792.212950:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918562176:12345-192.168.204.27@tcp:10:bash.0 Request processed in 475us (805us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787868792.212959:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00002000:00010000:0.0:1787868792.212963:0:8436:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787868792.212965:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d989057480 with x1874715918562176 ext(0->18446744073709551615) 00002000:00010000:0.0:1787868792.212969:0:8436:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d989057480. 00000100:00100000:2.0:1787868792.280686:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.281180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562304 00000100:00100000:1.0:1787868792.281191:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562304 00000100:00100000:1.0:1787868792.281258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:1.0:1787868792.281280:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+35:12410:x1874715918562304:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1787868792.281360:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281378:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281391:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281420:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281428:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281436:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281517:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281526:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281533:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787868792.281710:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281722:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281728:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281735:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281742:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868792.281747:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281761:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281776:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868792.281779:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868792.281784:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281790:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281830:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281836:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281842:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281847:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868792.281850:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281856:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281863:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93dabeadf800) 00010000:00010000:1.0:1787868792.281865:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868792.281868:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.281884:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282033:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282040:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282046:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282051:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868792.282054:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282060:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282069:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:1.0:1787868792.282071:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868792.282074:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.282079:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868792.282243:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+35:12410:x1874715918562304:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 964us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.282253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:2.0:1787868792.353195:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.353278:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562560 00000100:00100000:3.0:1787868792.353288:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562560 00000100:00100000:3.0:1787868792.353342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:3.0:1787868792.353351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+35:12413:x1874715918562560:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868792.353370:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868792.353388:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2de1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff262 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353456:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353470:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353482:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353495:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353503:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353509:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353696:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2de31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353706:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2de31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.353713:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2de31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868792.353722:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787868792.354078:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354087:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354093:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354099:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.354103:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354111:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354123:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868792.354126:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.354130:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354147:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2de23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354198:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354204:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354209:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354213:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868792.354216:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354222:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354229:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93da99ffb300) 00010000:00010000:3.0:1787868792.354232:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868792.354235:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354241:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2de2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354285:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2de1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff262 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354299:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2de31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff262 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.354312:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.354315:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787868792.354317:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868792.354378:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+37:12413:x1874715918562560:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1028us (1234us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787868792.354385:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:2.0:1787868792.360262:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.360396:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562688 00000100:00100000:0.0:1787868792.360406:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562688 00000100:00100000:0.0:1787868792.360479:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:0.0:1787868792.360489:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98902d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+37:12413:x1874715918562688:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1787868792.360559:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.360575:0:10190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 37 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.360585:0:10190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.360621:0:10190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 37 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.360633:0:10190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 37 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.360647:0:10190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939594752:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868792.360749:0:10190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868792.368220:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.368303:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918562944 00000100:00100000:1.0:1787868792.368313:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918562944 00000100:00100000:1.0:1787868792.368372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1787868792.368382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+38:6176:x1874715918562944:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787868792.368817:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+39:6176:x1874715918562944:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 435us (605us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787868792.368826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1787868792.368966:0:10190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10190:1874715939594752:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868792.368992:0:10190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868792.376618:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.376750:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918563072 00000100:00100000:3.0:1787868792.376759:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918563072 00010000:00010000:3.0:1787868792.376813:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 39 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868792.376857:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:3.0:1787868792.376867:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+39:2404:x1874715918563072:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868792.376883:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868792.376899:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 39 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.376913:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 39 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.376947:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2ddd6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff246 expref: 39 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.376962:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.376967:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.376990:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.376997:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.377031:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868792.377083:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+38:2404:x1874715918563072:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 217us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.377099:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00010000:00010000:0.0:1787868792.378363:0:10190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378377:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378430:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378438:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378445:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378450:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868792.378455:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378462:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378477:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:0.0:1787868792.378480:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868792.378483:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.378489:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.378562:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98902d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+37:12413:x1874715918562688:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 18072us (18309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.378572:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:2.0:1787868792.395083:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.395217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918563328 00000100:00100000:1.0:1787868792.395228:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918563328 00000100:00100000:1.0:1787868792.395294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1787868792.395306:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+37:12413:x1874715918563328:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1787868792.395531:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+38:12413:x1874715918563328:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 227us (456us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787868792.395538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1787868792.470871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.470955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918563584 00000100:00100000:1.0:1787868792.470965:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918563584 00000100:00100000:1.0:1787868792.471024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:1.0:1787868792.471035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+38:12424:x1874715918563584:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:1.0:1787868792.471063:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868792.471088:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff269 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471189:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471204:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471233:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471247:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471260:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471366:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2de5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471374:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2de5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471381:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2de5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868792.471390:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787868792.471456:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471462:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471468:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471475:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868792.471484:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471491:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868792.471506:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868792.471510:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471516:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2de4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471533:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471539:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471544:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471549:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868792.471552:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471557:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471564:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93dabeadf800) 00010000:00010000:1.0:1787868792.471566:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868792.471573:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471579:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2de54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471616:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2de46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff269 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471628:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2de5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff269 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.471635:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:1.0:1787868792.471637:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868792.471639:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1e00, rc 0) 00000100:00100000:1.0:1787868792.471692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+40:12424:x1874715918563584:12345-192.168.204.27@tcp:101:cat.0 Request processed in 659us (833us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787868792.471699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:2.0:1787868792.477014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.477078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918563840 00000100:00100000:1.0:1787868792.477096:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918563840 00000100:00100000:1.0:1787868792.477172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1787868792.477184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+40:12424:x1874715918563840:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:1.0:1787868792.477519:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+41:12424:x1874715918563840:12345-192.168.204.27@tcp:35:cat.0 Request processed in 336us (516us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787868792.477528:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1787868792.495777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.495877:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564096 00000100:00100000:0.0:1787868792.495895:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564096 00000100:00100000:0.0:1787868792.495952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 214 00000100:00100000:0.0:1787868792.495974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+41:12425:x1874715918564096:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:0.0:1787868792.496031:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787868792.496057:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2ddf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff254 expref: 41 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1e00/0x2f11f4d3bde2de5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff269 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496097:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c000/0x2f11f4d3bde2de31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff262 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496111:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2ddeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff24d expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496120:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:0.0:1787868792.496125:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868792.496145:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496207:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496217:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496232:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496238:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496252:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496391:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496401:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496408:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868792.496634:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:0.0:1787868792.496760:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496769:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496777:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496783:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496801:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496807:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496872:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868792.496914:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496920:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496924:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496930:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868792.496933:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496940:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496949:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:0.0:1787868792.496952:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787868792.496955:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496961:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de77 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496976:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496982:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496987:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.496992:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868792.497001:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.497008:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.497016:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868792.497018:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868792.497021:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.497026:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868792.497036:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d53c683 reply state 00000000b966ac8d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.497046:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.497052:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:0.0:1787868792.497054:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868792.497056:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868792.497134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+39:12425:x1874715918564096:12345-192.168.204.27@tcp:36:rm.0 Request processed in 1160us (1365us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787868792.497979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 214 00010000:00010000:3.0:1787868792.499444:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868792.499457:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.499468:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868792.499472:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.499481:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.499501:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:3.0:1787868792.499504:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787868792.499509:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.499516:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2de7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.499528:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868792.499541:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868792.499543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868792.549041:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.549785:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564352 00000100:00100000:0.0:1787868792.549812:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564352 00000100:00100000:0.0:1787868792.549887:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:0.0:1787868792.549904:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+39:12431:x1874715918564352:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868792.549933:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.549966:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff270 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550075:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550091:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550102:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550114:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550120:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.550132:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868792.550982:0:10190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787868792.551216:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551229:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551238:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551277:0:10190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551299:0:10190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551306:0:10190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551312:0:10190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868792.551317:0:10190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551325:0:10190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551339:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868792.551342:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868792.551348:0:10190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551354:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2de8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787868792.551368:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038ce9ebd reply state 00000000594d6fb3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551380:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551387:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:0.0:1787868792.551389:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868792.551392:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787868792.551424:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286c00/0x2f11f4d3bde2de85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 42 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551448:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 41 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.551455:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:0.0:1787868792.551458:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868792.551460:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868792.551540:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+42:12431:x1874715918564352:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1642us (2509us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787868792.551548:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:2.0:1787868792.557290:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.557386:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564480 00000100:00100000:0.0:1787868792.557397:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564480 00000100:00100000:0.0:1787868792.557872:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868792.557883:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918564480:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868792.558038:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.558065:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff277 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868792.558265:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787868792.558289:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1787868792.558295:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.558309:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.558331:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787868792.558424:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787868792.558444:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787868792.558523:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+8:2406:x1874715918564480:12345-192.168.204.27@tcp:101:bash.0 Request processed in 642us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.558531:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1787868792.563439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.563508:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564608 00000100:00100000:0.0:1787868792.563520:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564608 00000100:00100000:0.0:1787868792.563583:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1787868792.563594:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+8:12431:x1874715918564608:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868792.563617:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.563637:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff27e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.563675:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.563685:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.563690:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.563696:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.563734:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.563747:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.563780:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1874715939594880:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868792.563912:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868792.567825:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1874715939594880:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868792.567865:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.567888:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868792.567952:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+9:12431:x1874715918564608:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4359us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.567961:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:3.0:1787868792.568054:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.568357:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564736 00000100:00100000:0.0:1787868792.568365:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564736 00010000:00010000:0.0:1787868792.568396:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.568431:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:0.0:1787868792.568441:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+9:2404:x1874715918564736:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868792.568464:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868792.568487:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.568511:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.568555:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003388c59d/0x2f11f4d3bde2dea8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff277 expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.568744:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.568748:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868792.568757:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.568769:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.568816:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.568831:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1874715939595008:192.168.204.27@tcp:105: 00000100:00100000:0.0:1787868792.568900:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868792.572925:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.573024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918564992 00000100:00100000:3.0:1787868792.573035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918564992 00000100:00100000:3.0:1787868792.573188:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1787868792.573200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+42:12431:x1874715918564992:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1787868792.573535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+43:12431:x1874715918564992:12345-192.168.204.27@tcp:35:bash.0 Request processed in 337us (620us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787868792.573544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1787868792.573594:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1874715939595008:192.168.204.27@tcp:105: 00010000:00010000:0.0:1787868792.573619:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868792.573660:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918564736:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 5220us (5606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.573685:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:1.0:1787868792.609392:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939595136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868792.609479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868792.609744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939595136 00000100:00100000:0.0:1787868792.609753:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939595136 00000100:00100000:0.0:1787868792.609812:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787868792.609828:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939595136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868792.609851:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1787868792.609867:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868792.609880:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939595264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868792.609895:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939595136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.609904:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787868792.609998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868792.610053:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939595136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868792.610056:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939595264 00000100:00100000:1.0:1787868792.610062:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939595264 00000100:00100000:1.0:1787868792.610103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787868792.610110:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939595264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868792.610145:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868792.610264:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939595264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.610271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787868792.610447:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939595264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868792.613493:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868792.613519:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868792.613587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868792.614337:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939595392 00000100:00100000:0.0:1787868792.614346:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939595392 00000100:00100000:0.0:1787868792.614405:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868792.614416:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939595392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868792.614439:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787868792.614502:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939595392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.614509:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787868792.614659:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868792.788323:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.788448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918565120 00000100:00100000:1.0:1787868792.788458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918565120 00000100:00100000:1.0:1787868792.788528:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:1.0:1787868792.788539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+43:12447:x1874715918565120:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868792.788562:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868792.788581:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2deb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff285 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788649:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788663:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788675:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868792.788730:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787868792.788734:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868792.788755:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788808:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2deb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff285 expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788835:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff285 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.788844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868792.788847:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787868792.788851:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0200, rc 0) 00000100:00100000:1.0:1787868792.788911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+44:12447:x1874715918565120:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 375us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.788919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:2.0:1787868792.804082:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.804203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918565376 00000100:00100000:0.0:1787868792.804215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918565376 00000100:00100000:0.0:1787868792.804289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:0.0:1787868792.804299:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+44:12447:x1874715918565376:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868792.804322:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.804344:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dec4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff28c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.804458:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2decb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.804473:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2decb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.804502:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2decb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868792.804528:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787868792.804631:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dec4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff28c expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.804652:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2decb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff28c expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.804661:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:0.0:1787868792.804664:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868792.804668:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:0.0:1787868792.804733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+46:12447:x1874715918565376:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 434us (662us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787868792.804741:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:2.0:1787868792.811710:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.812417:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918565632 00000100:00100000:0.0:1787868792.812431:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918565632 00000100:00100000:0.0:1787868792.812503:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:0.0:1787868792.812515:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+46:12447:x1874715918565632:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868792.812540:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868792.812562:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2ded9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff293 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.812671:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.812685:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.812717:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868792.812744:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787868792.812875:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2ded9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff293 expref: 49 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.812908:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff293 expref: 48 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.812916:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:0.0:1787868792.812920:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787868792.812923:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868792.813874:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+48:12447:x1874715918565632:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 485us (1298us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787868792.813895:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:2.0:1787868792.818245:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.818330:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918565760 00000100:00100000:3.0:1787868792.818342:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918565760 00000100:00100000:3.0:1787868792.818412:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1787868792.818423:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+48:2406:x1874715918565760:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868792.818440:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868792.818470:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2decb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff28c expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.818490:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:3.0:1787868792.818495:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868792.818553:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+47:2406:x1874715918565760:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.818576:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787868792.831536:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.831630:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918565888 00000100:00100000:1.0:1787868792.831641:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918565888 00000100:00100000:1.0:1787868792.831708:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1787868792.831719:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918565888:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:1.0:1787868792.831776:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.831809:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.831818:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868792.831823:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787868792.831828:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.831899:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.831914:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 8 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868792.831930:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1874715939595520:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868792.832037:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868792.836629:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.836736:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566016 00000100:00100000:0.0:1787868792.836747:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566016 00002000:00100000:0.0:1787868792.836813:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93d989064780 x1874715918566016/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:113/0 lens 504/0 e 0 to 0 dl 1787868803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868792.836825:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d989064780 with x1874715918566016 ext(0->8) 00010000:00010000:0.0:1787868792.836834:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 9 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.836851:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 9 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868792.836879:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d989064780 00000100:00100000:0.0:1787868792.836926:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1787868792.836936:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+9:2404:x1874715918566016:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:1.0:1787868792.837740:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1874715939595520:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868792.837767:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.838106:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+11:2404:x1874715918566016:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 1169us (1485us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787868792.838116:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00002000:00100000:0.0:1787868792.838125:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93d989064780 x1874715918566016/t4294967309(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:113/0 lens 504/448 e 0 to 0 dl 1787868803 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868792.838134:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d989064780 with x1874715918566016 ext(0->8) 00010000:00010000:0.0:1787868792.838141:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.838181:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868792.838191:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d989064780 00000100:00100000:3.0:1787868792.850669:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868792.850778:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566144 00000100:00100000:2.0:1787868792.850802:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566144 00010000:00010000:2.0:1787868792.850845:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868792.850898:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1787868792.850909:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918566144:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868792.850926:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787868792.850958:0:7463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787868792.850961:0:7463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787868792 00002000:00010000:2.0:1787868792.850963:0:7463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787868792 00002000:00010000:2.0:1787868792.850965:0:7463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787868792 00002000:00010000:2.0:1787868792.850967:0:7463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787868792.850973:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.851019:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.851047:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004612b5c2/0x2f11f4d3bde2deaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff27e expref: 11 pid: 8429 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.851064:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868792.851069:0:7463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868792.851076:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.851086:0:7463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.851125:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868792.851233:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+10:2403:x1874715918566144:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 325us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868792.851241:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00010000:00010000:1.0:1787868792.851477:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851488:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851510:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851519:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851539:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851546:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868792.851550:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851558:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851571:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.851579:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000468ecd02/0x2f11f4d3bde2deee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868792.851638:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918565888:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 19921us (20113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868792.851646:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1787868792.862007:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868792.862206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566400 00000100:00100000:1.0:1787868792.862217:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566400 00000100:00100000:1.0:1787868792.862275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1787868792.862286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+47:12447:x1874715918566400:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:1.0:1787868792.862355:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff293 expref: 47 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868792.862588:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787868792.862620:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787868792.862931:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1787868792.862968:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.862983:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 51 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868792.862991:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.863260:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 51 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.863276:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 51 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868792.863292:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874715939595648:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868792.863393:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868792.870422:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868792.870509:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566528 00000100:00100000:0.0:1787868792.870519:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566528 00010000:00010000:0.0:1787868792.870560:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 52 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868792.870604:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:0.0:1787868792.870613:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+52:2403:x1874715918566528:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868792.870653:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868792.870660:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 52 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.870675:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 52 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.870699:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:0.0:1787868792.870704:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.870713:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.870721:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868792.870747:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868792.870809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+52:2403:x1874715918566528:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868792.870817:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00010000:00010000:3.0:1787868792.871122:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2de9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff270 expref: 51 pid: 10190 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868792.871139:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874715939595648:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868792.871213:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.871224:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.871229:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868792.871352:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1787868792.871471:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1787868792.871565:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874715939595776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787868792.871622:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868792.871674:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9170cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868792.871698:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939595776 00000100:00100000:3.0:1787868792.871702:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939595776 00000100:00100000:3.0:1787868792.871750:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787868792.871759:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1874715939595776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787868792.871850:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1874715939595776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.871873:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787868792.871911:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874715939595776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787868792.875221:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787868792.875333:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874715939595904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787868792.875410:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868792.875445:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9170ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868792.875639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939595904 00000100:00100000:0.0:1787868792.875649:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939595904 00000100:00100000:0.0:1787868792.875713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787868792.875734:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1874715939595904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787868792.876137:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6515:x1874715939595904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 414us (726us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787868792.876146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787868792.876513:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874715939595904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787868792.876577:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787868792.876620:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876646:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876654:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876659:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868792.876664:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876672:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876694:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:2.0:1787868792.876697:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787868792.876702:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868792.876709:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2def5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787868792.876849:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787868792.877254:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787868792.877268:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417003111091ns, next at 418003108013ns, rc = 0 00000001:00080000:2.0:1787868792.877285:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787868792.877315:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d9870ca100) 00010000:00010000:2.0:1787868792.877318:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787868792.877325:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2dee0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff293 expref: 55 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868792.877426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+54:12447:x1874715918566400:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 15142us (15439us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787868792.877434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000020:00080000:2.0:1787868792.877437:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787868792.884043:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.885146:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566656 00000100:00100000:3.0:1787868792.885190:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566656 00000100:00100000:3.0:1787868792.885252:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:3.0:1787868792.885263:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+54:12447:x1874715918566656:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868792.885288:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868792.885312:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2defc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff29a expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.885375:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2defc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff29a expref: 55 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.885392:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2defc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff29a expref: 55 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868792.885412:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868792.885415:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868792.885419:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c600, rc 0) 00000100:00100000:3.0:1787868792.885480:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+55:12447:x1874715918566656:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 218us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868792.885487:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:0.0:1787868792.895429:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868792.895544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918566912 00000100:00100000:3.0:1787868792.895554:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918566912 00000100:00100000:3.0:1787868792.895608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787868792.895617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+55:12447:x1874715918566912:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868792.896546:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+56:12447:x1874715918566912:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 924us (1123us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787868792.896558:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00010000:00010000:1.0:1787868792.929331:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868793.016760:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.016911:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567040 00000100:00100000:3.0:1787868793.016922:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567040 00000100:00100000:3.0:1787868793.017004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:3.0:1787868793.017015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+56:12457:x1874715918567040:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1787868793.017095:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017113:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017124:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017134:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017142:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017147:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017255:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017278:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017285:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868793.017334:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017348:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017354:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017360:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017366:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.017370:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017378:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017391:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868793.017394:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868793.017399:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017405:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017429:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017435:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017441:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017446:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.017449:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017456:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017464:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:3.0:1787868793.017467:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868793.017470:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017477:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017486:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017492:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017497:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017508:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.017511:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017518:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017526:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868793.017529:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868793.017532:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.017538:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868793.017611:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+56:12457:x1874715918567040:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 597us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868793.017620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:0.0:1787868793.058178:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.058216:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.058253:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.058281:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.058308:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.058337:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567168 00000100:00100000:0.0:1787868793.058346:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567168 00000100:00100000:0.0:1787868793.058401:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 395 00000100:00100000:0.0:1787868793.058411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918567168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868793.058478:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918567168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.058486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 395 00000100:00100000:0.0:1787868793.058524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567296 00000100:00100000:0.0:1787868793.058528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567296 00000100:00100000:0.0:1787868793.058562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567552 00000100:00100000:0.0:1787868793.058565:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567552 00000100:00100000:0.0:1787868793.058583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567680 00000100:00100000:0.0:1787868793.058586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567680 00000100:00100000:0.0:1787868793.058600:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 364 00000100:00100000:0.0:1787868793.058606:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918567296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868793.058638:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918567296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.058645:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 364 00000100:00100000:0.0:1787868793.058657:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:0.0:1787868793.058664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918567552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868793.058687:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918567552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.058710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:0.0:1787868793.058723:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 366 00000100:00100000:0.0:1787868793.058730:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918567680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868793.058757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918567680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.058762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 366 00000100:00100000:2.0:1787868793.058895:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567424 00000100:00100000:2.0:1787868793.058900:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567424 00000100:00100000:2.0:1787868793.058938:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:2.0:1787868793.058946:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+9:2406:x1874715918567424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868793.058973:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+9:2406:x1874715918567424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.058980:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00080000:1.0:1787868793.059510:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868793.059517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868793.059519:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868793.100015:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.100210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918567936 00000100:00100000:2.0:1787868793.100220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918567936 00000100:00100000:2.0:1787868793.100278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1787868793.100289:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+56:12460:x1874715918567936:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868793.100311:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868793.100335:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2df18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2a1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100434:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100449:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100460:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100471:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100478:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100485:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100591:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2df2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100600:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2df2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100608:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2df2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868793.100619:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787868793.100705:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100713:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100727:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100733:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868793.100738:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100747:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100759:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868793.100762:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868793.100767:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100774:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2df1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100801:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100808:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100814:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100819:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868793.100823:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100839:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100848:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:2.0:1787868793.100850:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868793.100854:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100860:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100894:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2df18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100908:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2df2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a1 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.100914:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868793.100917:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868793.100919:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:2.0:1787868793.100985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+58:12460:x1874715918567936:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 698us (995us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787868793.101537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1787868793.109283:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.109372:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918568064 00000100:00100000:3.0:1787868793.109382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918568064 00000100:00100000:3.0:1787868793.109447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:3.0:1787868793.109458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+58:12460:x1874715918568064:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1787868793.109524:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109541:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109554:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109600:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109608:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109615:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109621:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.109626:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109633:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109645:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868793.109648:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868793.109652:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.109658:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868793.109745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+58:12460:x1874715918568064:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 288us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868793.109753:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:0.0:1787868793.114076:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.114234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918568320 00000100:00100000:2.0:1787868793.114244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918568320 00000100:00100000:2.0:1787868793.114301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1787868793.114312:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+58:12460:x1874715918568320:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1787868793.114588:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+59:12460:x1874715918568320:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 276us (521us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787868793.114597:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1787868793.216416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868793.216515:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918568576 00000100:00100000:1.0:1787868793.216524:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918568576 00000100:00100000:1.0:1787868793.216582:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:1.0:1787868793.216592:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+59:12470:x1874715918568576:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1787868793.216619:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868793.216623:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787868793.216651:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2debd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff285 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.216676:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868793.216682:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868793.216695:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2a8 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.216845:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.216860:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.216880:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868793.216892:0:10190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787868793.217460:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.217479:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 60 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.217488:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868793.217491:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868793.217494:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1400, rc 0) 00000100:00100000:1.0:1787868793.217545:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+60:12470:x1874715918568576:12345-192.168.204.27@tcp:101:bash.0 Request processed in 954us (1139us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787868793.217553:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:0.0:1787868793.222615:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.222697:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918568704 00000100:00100000:2.0:1787868793.222709:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918568704 00000100:00100000:2.0:1787868793.222796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 224 00000100:00100000:2.0:1787868793.222807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+60:12470:x1874715918568704:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868793.222833:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868793.222854:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2df57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2af expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.222904:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.222918:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.222929:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.223253:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2df57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.223272:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.223280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868793.223283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868793.223294:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868793.223345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+61:12470:x1874715918568704:12345-192.168.204.27@tcp:101:bash.0 Request processed in 541us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.223353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 224 00000100:00100000:0.0:1787868793.227894:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.229265:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868793.229342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569088 00000100:00100000:1.0:1787868793.229351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569088 00000100:00100000:1.0:1787868793.229408:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:1.0:1787868793.229418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+61:12470:x1874715918569088:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1787868793.229471:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868793.229515:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2df2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a1 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.229534:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868793.229539:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868793.229709:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.229737:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.229748:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.229792:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.229808:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868793.229823:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939596032:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868793.229924:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef780 going to sleep for 11 seconds 00010000:00010000:1.0:1787868793.232853:0:6514:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.27@tcp) returned -22 from blocking AST (req@00000000b87b9ae1 x1874715939596032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.232891:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.232952:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1400/0x2f11f4d3bde2df49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2a8 expref: 61 pid: 10190 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868793.232976:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939596032:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868793.233006:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868793.233011:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233021:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233029:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233050:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233058:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233064:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868793.233147:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787868793.233218:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067359d93 reply state 0000000062d4278c transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233231:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.233248:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868793.233251:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868793.233254:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868793.233350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+62:12470:x1874715918569088:12345-192.168.204.27@tcp:36:bash.0 Request processed in 3933us (4091us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787868793.233360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 225 00000020:00080000:1.0:1787868793.233366:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787868793.234697:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918568832 00000100:00100000:2.0:1787868793.234708:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918568832 00000100:00100000:2.0:1787868793.234786:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787868793.234798:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+62:2404:x1874715918568832:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868793.234813:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868793.234816:0:7463:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 2f11f4d3bde2df49) 00010000:00010000:2.0:1787868793.234818:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868793.234866:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+62:2404:x1874715918568832:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 71us (6982us total) trans 0 rc 116/116 00000100:00100000:2.0:1787868793.234885:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1787868793.241548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.241634:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569216 00000100:00100000:3.0:1787868793.241645:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569216 00000100:00100000:3.0:1787868793.241709:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:3.0:1787868793.241737:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+62:12470:x1874715918569216:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868793.241788:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868793.241816:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2b6 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242253:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242273:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242284:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868793.242320:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787868793.242324:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868793.242345:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242371:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 64 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242390:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 63 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.242399:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868793.242402:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868793.242406:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d400, rc 0) 00000100:00100000:3.0:1787868793.242483:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+63:12470:x1874715918569216:12345-192.168.204.27@tcp:101:bash.0 Request processed in 751us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868793.242500:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1787868793.250665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.250807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569472 00000100:00100000:2.0:1787868793.250818:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569472 00000100:00100000:2.0:1787868793.250879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1787868793.250891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+63:12470:x1874715918569472:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1787868793.251476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+64:12470:x1874715918569472:12345-192.168.204.27@tcp:35:bash.0 Request processed in 586us (821us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787868793.251484:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1787868793.352455:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.352635:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569600 00000100:00100000:3.0:1787868793.352646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569600 00000100:00100000:3.0:1787868793.352811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:3.0:1787868793.352824:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+64:12476:x1874715918569600:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868793.352851:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868793.352873:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.352941:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.352956:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.352969:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868793.353014:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787868793.353019:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868793.353038:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.353064:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2df7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2bd expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.353082:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2bd expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.353111:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868793.353114:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868793.353118:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ce00, rc 0) 00000100:00100000:3.0:1787868793.353385:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918569600:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 564us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868793.353393:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:0.0:1787868793.357083:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868793.357196:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569728 00000100:00100000:1.0:1787868793.357206:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569728 00000100:00100000:1.0:1787868793.357260:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:1.0:1787868793.357270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918569728:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868793.357300:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868793.357321:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2df88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357395:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357409:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357421:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357434:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357441:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357463:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357539:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357548:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357570:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868793.357614:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787868793.357618:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868793.357635:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357647:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357654:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357659:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357665:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357670:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868793.357673:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357687:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357699:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:1.0:1787868793.357701:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868793.357705:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2df8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357729:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357735:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357739:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357743:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868793.357746:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357751:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357757:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:1.0:1787868793.357760:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868793.357762:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357789:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2df96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357817:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2df88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2c4 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357831:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2c4 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.357838:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868793.357840:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868793.357842:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1a00, rc 0) 00000100:00100000:1.0:1787868793.357907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+66:12476:x1874715918569728:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 639us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868793.357915:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:1.0:1787868793.368318:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.368580:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918569856 00000100:00100000:0.0:1787868793.368591:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918569856 00000100:00100000:0.0:1787868793.368663:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868793.368674:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+66:2406:x1874715918569856:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868793.368690:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868793.368731:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2df9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2c4 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.368757:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:0.0:1787868793.368763:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868793.368855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+65:2406:x1874715918569856:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 182us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.368864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868793.373263:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.373346:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570112 00000100:00100000:3.0:1787868793.373356:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570112 00000100:00100000:3.0:1787868793.373414:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:3.0:1787868793.373423:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918570112:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868793.373444:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868793.373465:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2dfa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2cb expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.373583:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.373598:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 66 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.373608:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.373642:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 66 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.373657:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 66 pid: 13805 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868793.373685:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1874715939596160:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868793.373844:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daafdd6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868793.377428:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1874715939596160:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868793.377464:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868793.380191:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.380324:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570240 00000100:00100000:2.0:1787868793.380334:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570240 00010000:00010000:2.0:1787868793.380381:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 67 pid: 13805 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868793.380454:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:2.0:1787868793.380483:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+67:2404:x1874715918570240:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868793.380501:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868793.380508:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 67 pid: 13805 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380523:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 67 pid: 13805 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380546:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2df73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2b6 expref: 67 pid: 13805 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380569:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868793.380575:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380586:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380593:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.380629:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868793.380698:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+66:2404:x1874715918570240:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 217us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.380707:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00010000:00010000:3.0:1787868793.380780:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.380791:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868793.380811:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787868793.380953:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2dfa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 67 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.380969:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 66 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.380976:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868793.380979:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787868793.380981:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d000, rc 0) 00000100:00100000:3.0:1787868793.381030:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+66:12476:x1874715918570112:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 7608us (7778us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787868793.381037:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:0.0:1787868793.396397:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.396584:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570496 00000100:00100000:3.0:1787868793.396613:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570496 00000100:00100000:3.0:1787868793.396704:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1787868793.396716:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+66:12476:x1874715918570496:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:3.0:1787868793.396733:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868793.396764:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2defc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff29a expref: 66 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.396803:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868793.396809:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868793.397093:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918570496:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 378us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.397102:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1787868793.415809:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.416463:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570624 00000100:00100000:3.0:1787868793.416473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570624 00000100:00100000:2.0:1787868793.416733:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:2.0:1787868793.416745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918570624:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:2.0:1787868793.416969:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.416997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.417008:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787868793.417109:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787868793.417217:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918570624:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 474us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.417224:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:1.0:1787868793.423069:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.423467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570752 00000100:00100000:2.0:1787868793.423478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570752 00000100:00100000:2.0:1787868793.423538:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00100000:2.0:1787868793.423546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+65:12476:x1874715918570752:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868793.423690:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868793.423714:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2d2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423769:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423793:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423827:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423843:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423876:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868793.423880:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868793.423884:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.423893:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868793.423959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+66:12476:x1874715918570752:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 413us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.423966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 231 00000040:00080000:3.0:1787868793.890122:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868793.890133:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868793.890193:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787868793.890203:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868793.890332:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939596288:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868793.890430:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868793.896043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.896277:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918570880 00000100:00100000:0.0:1787868793.896287:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918570880 00000100:00100000:0.0:1787868793.896347:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:0.0:1787868793.896358:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918570880:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787868793.896389:0:13805:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787868793.896505:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918570880:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 149us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868793.896513:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:3.0:1787868793.897457:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939596288:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787868793.907573:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.907677:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918571008 00000100:00100000:2.0:1787868793.907687:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918571008 00000100:00100000:2.0:1787868793.907750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:2.0:1787868793.907775:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+66:12477:x1874715918571008:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787868793.907871:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.907890:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.907906:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.907957:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.907965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.907972:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908124:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908133:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908139:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868793.908229:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787868793.908234:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868793.908248:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908260:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908266:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908273:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908288:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868793.908293:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908301:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908314:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:2.0:1787868793.908316:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868793.908321:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908327:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2dfc7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908341:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908347:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908353:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908359:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868793.908361:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908367:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93dab5bab100) 00010000:00010000:2.0:1787868793.908389:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868793.908393:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908399:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2dfce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908414:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908420:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908425:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908430:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868793.908433:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908438:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908444:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868793.908446:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868793.908449:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.908454:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2dfd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868793.908550:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+66:12477:x1874715918571008:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 790us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.908558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:2.0:1787868793.914949:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.915106:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918571264 00000100:00100000:0.0:1787868793.915116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918571264 00000100:00100000:0.0:1787868793.915221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:0.0:1787868793.915232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+66:12477:x1874715918571264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868793.915253:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868793.915273:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dfdc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915375:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915391:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915417:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868793.915429:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787868793.915512:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915520:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915526:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915532:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868793.915536:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915543:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915555:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:0.0:1787868793.915558:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787868793.915562:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915567:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dfe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915604:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dfdc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d9 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915625:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:0.0:1787868793.915627:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868793.915631:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dfdc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d9 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.915640:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287800, rc 0) 00000100:00100000:0.0:1787868793.915700:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918571264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 471us (761us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1787868793.915708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:1.0:1787868793.930424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.931109:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918571392 00000100:00100000:2.0:1787868793.931121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918571392 00000100:00100000:2.0:1787868793.931215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1787868793.931226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918571392:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787868793.931264:0:6514:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787868793.931687:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918571392:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 461us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.931696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1787868793.941370:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.942186:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918571648 00000100:00100000:0.0:1787868793.942198:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918571648 00000100:00100000:0.0:1787868793.942311:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:0.0:1787868793.942323:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918571648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868793.942344:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868793.942348:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787868793.942376:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2df81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2bd expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.942399:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:0.0:1787868793.942404:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868793.942418:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dff1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2e0 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868793.942794:0:10190:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787868793.943141:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.943263:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.943274:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.943331:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2dff1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e0 expref: 69 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.943348:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e0 expref: 68 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.943356:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d9870ca500) 00010000:00010000:0.0:1787868793.943358:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787868793.943360:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787868793.943431:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+68:12477:x1874715918571648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1111us (2072us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787868793.943439:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1787868793.949792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.950393:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918571904 00000100:00100000:3.0:1787868793.950404:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918571904 00000100:00100000:3.0:1787868793.950467:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:3.0:1787868793.950478:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+68:12477:x1874715918571904:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868793.950538:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868793.950567:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2dff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e0 expref: 68 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950596:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d9870ca500) 00010000:00010000:3.0:1787868793.950624:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868793.950647:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950661:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950672:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950740:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950748:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950755:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950809:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950816:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950823:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950829:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.950834:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.950842:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.951820:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868793.951823:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868793.951829:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.951836:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2e006 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952331:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952340:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952346:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952352:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868793.952355:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952362:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952372:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa927f5b8 (ffff93da99ffb600) 00010000:00010000:3.0:1787868793.952375:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868793.952378:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.952383:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e00d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa927f5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868793.952548:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918571904:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 2068us (2764us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787868793.952558:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 237 00010000:00010000:0.0:1787868793.953352:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868793.962368:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868793.962826:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918572032 00000100:00100000:2.0:1787868793.962837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918572032 00000100:00100000:2.0:1787868793.962959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:2.0:1787868793.962971:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+67:12477:x1874715918572032:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868793.964381:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868793.964413:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e014 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964461:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964479:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964508:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964617:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e014 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 69 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964635:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868793.964643:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:2.0:1787868793.964646:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868793.964649:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80031000, rc 0) 00000100:00100000:2.0:1787868793.964718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+68:12477:x1874715918572032:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1750us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868793.964727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:2.0:1787868793.975715:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.975873:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918572288 00000100:00100000:0.0:1787868793.975887:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918572288 00000100:00100000:0.0:1787868793.976011:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:0.0:1787868793.976023:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+68:12477:x1874715918572288:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787868793.976143:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.976351:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868793.976387:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868793.977392:0:10190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787868793.977409:0:10190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418103252694ns, next at 419103248945ns, rc = 0 00000004:00010000:1.0:1787868793.977484:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d53c683 reply state 00000000bd5897e6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.977508:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868793.977536:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868793.977539:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787868793.977545:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868793.978095:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+70:12477:x1874715918572288:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 2066us (2387us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787868793.978108:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:1.0:1787868793.984252:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868793.984644:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918572416 00000100:00100000:3.0:1787868793.984658:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918572416 00000100:00100000:3.0:1787868793.984748:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:3.0:1787868793.984770:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+70:12477:x1874715918572416:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868793.984806:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868793.984834:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2ee expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.984923:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 71 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.984942:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 71 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868793.984965:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:3.0:1787868793.984968:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868793.984973:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d200, rc 0) 00000100:00100000:3.0:1787868793.985120:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+71:12477:x1874715918572416:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 361us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868793.985129:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:2.0:1787868793.989359:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.989484:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918572544 00000100:00100000:0.0:1787868793.989498:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918572544 00000100:00100000:0.0:1787868793.989585:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:0.0:1787868793.989602:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918572544:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787868793.990299:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+10:2403:x1874715918572544:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 701us (951us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787868793.990309:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:2.0:1787868793.997876:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868793.998096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918572800 00000100:00100000:0.0:1787868793.998111:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918572800 00000100:00100000:0.0:1787868793.998256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1787868793.998269:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+71:12477:x1874715918572800:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787868793.998847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+72:12477:x1874715918572800:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 577us (993us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787868793.998867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1787868794.003488:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.004481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573056 00000100:00100000:1.0:1787868794.004499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573056 00000100:00100000:1.0:1787868794.004734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:1.0:1787868794.004771:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+72:12477:x1874715918573056:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787868794.006598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+72:12477:x1874715918573056:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 1828us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.006616:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00080000:2.0:1787868794.010089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868794.011563:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.011681:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573184 00000100:00100000:2.0:1787868794.011695:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573184 00000100:00100000:2.0:1787868794.011852:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:2.0:1787868794.011867:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+72:12477:x1874715918573184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868794.011898:0:10190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868794.011933:0:10190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2e030 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2f5 expref: -99 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012298:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012318:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012402:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868794.012464:0:10190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868794.012491:0:10190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012528:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031a00/0x2f11f4d3bde2e030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2f5 expref: 74 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012551:0:10190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2f5 expref: 73 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.012561:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:2.0:1787868794.012565:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787868794.012569:0:10190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030a00, rc 0) 00000100:00100000:2.0:1787868794.012664:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+73:12477:x1874715918573184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 801us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868794.012673:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:2.0:1787868794.020351:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868794.020685:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573312 00000100:00100000:3.0:1787868794.020717:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573312 00000100:00100000:3.0:1787868794.020822:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:3.0:1787868794.020970:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+10:2404:x1874715918573312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868794.021068:0:8962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868794.021108:0:8962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff2fc expref: -99 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787868794.021143:0:8962:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b679, blocks: 0x0 00010000:00010000:3.0:1787868794.021203:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787868794.021210:0:8962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868794.021223:0:8962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 11 pid: 8962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868794.021246:0:8962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 11 pid: 8962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868794.021263:0:8962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c600, rc 0) 00000100:00100000:3.0:1787868794.021349:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+11:2404:x1874715918573312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 500us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868794.021357:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1787868794.030401:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.037224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573568 00000100:00100000:0.0:1787868794.037250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573568 00000100:00100000:0.0:1787868794.037992:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:0.0:1787868794.038014:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+73:12477:x1874715918573568:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787868794.040065:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+73:12477:x1874715918573568:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 2044us (9736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868794.040081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:1.0:1787868794.045811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.045975:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573696 00000100:00100000:0.0:1787868794.045989:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573696 00000100:00100000:0.0:1787868794.046147:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1787868794.046211:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+11:12477:x1874715918573696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868794.046237:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868794.046262:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff303 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.046304:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.046315:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868794.046321:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868794.046339:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.046387:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.046402:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.046418:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939596416:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868794.046540:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868794.051293:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.051615:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1874715939596416:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868794.051729:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.052114:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:1.0:1787868794.052356:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573824 00000100:00100000:1.0:1787868794.052365:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573824 00010000:00010000:1.0:1787868794.052415:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 13 pid: 8962 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.052440:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+13:12477:x1874715918573696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 6282us (6646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868794.052450:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:1.0:1787868794.052466:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:1.0:1787868794.052476:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+12:2403:x1874715918573824:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868794.052494:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.052531:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.052545:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.052577:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040a22ee1/0x2f11f4d3bde2e03e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2fc expref: 12 pid: 8962 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.052600:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868794.052606:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868794.052616:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.052630:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.052673:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.052690:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874715939596544:192.168.204.27@tcp:105: 00000100:00100000:1.0:1787868794.052777:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868794.065927:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874715939596544:192.168.204.27@tcp:105: 00010000:00010000:1.0:1787868794.065968:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868794.066047:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918573824:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 13570us (14768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.066083:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:2.0:1787868794.068543:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.068791:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918573952 00000100:00100000:0.0:1787868794.068806:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918573952 00002000:00100000:0.0:1787868794.068947:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93d9882db840 x1874715918573952/t0(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:115/0 lens 504/0 e 0 to 0 dl 1787868805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868794.068962:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9882db840 with x1874715918573952 ext(0->12) 00002000:00010000:0.0:1787868794.068970:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9882db840 00000100:00100000:0.0:1787868794.069055:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1787868794.069068:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+11:2403:x1874715918573952:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787868794.073083:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:666039a7-1461-4e99-8c4e-10237114565a+13:2403:x1874715918573952:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 3995us (4536us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787868794.073125:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00002000:00100000:2.0:1787868794.073145:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93d9882db840 x1874715918573952/t4294967321(0) o4->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:115/0 lens 504/448 e 0 to 0 dl 1787868805 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787868794.074278:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9882db840 with x1874715918573952 ext(0->12) 00002000:00010000:2.0:1787868794.074290:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9882db840 00000100:00100000:3.0:1787868794.077888:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.078273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574080 00000100:00100000:2.0:1787868794.078287:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574080 00000100:00100000:2.0:1787868794.078546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:2.0:1787868794.078561:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+73:12477:x1874715918574080:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787868794.082344:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787868794.082367:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:1.0:1787868794.082429:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082452:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082462:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082469:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868794.082474:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082484:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868794.082503:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:1.0:1787868794.082512:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93da82a4d800) 00010000:00010000:1.0:1787868794.082520:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868794.082528:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082536:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2dd4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787868794.082549:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93daae7a6cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787868794.082560:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d98819ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93daae7a6900 00000020:00080000:0.0:1787868794.082564:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d98819b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d986dfdc00 00010000:00010000:1.0:1787868794.082601:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082609:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082615:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787868794.082636:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93da91620240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787868794.082651:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9883bfa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93dabd8c0a80 00010000:00010000:1.0:1787868794.082656:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00000020:00080000:0.0:1787868794.082658:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9883bf400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d988820c00 00010000:00010000:1.0:1787868794.082663:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082672:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082684:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93da99ffbe00) 00010000:00010000:1.0:1787868794.082687:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868794.082690:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082696:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ddf2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082720:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082727:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082734:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082740:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868794.082743:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082750:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082788:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:1.0:1787868794.082791:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868794.082795:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082802:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2de70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082823:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082830:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082836:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082842:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868794.082847:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.082853:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.082862:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:12477:x1874715918574080:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 4296us (4980us total) trans 0 rc 0/0 00010000:00010000:1.0:1787868794.082868:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d9870cae00) 00010000:00010000:1.0:1787868794.082872:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868794.082874:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083044:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2de93 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083076:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083083:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083088:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083094:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868794.083097:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083103:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083112:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868794.083115:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868794.083118:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083124:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2df65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083147:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083219:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083226:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083241:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868794.083244:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083250:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083259:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.083261:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787868794.083264:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.083271:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287800/0x2f11f4d3bde2e022 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.084301:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868794.084340:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939596800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787868794.084447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868794.084521:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939596672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787868794.084557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787868794.084584:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787868794.084656:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787868794.084673:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868794.084698:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939596928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787868794.084791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868794.084849:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939596800 00000100:00100000:3.0:1787868794.084888:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939596800 00000100:00100000:0.0:1787868794.085189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:2.0:1787868794.085300:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939596672 00000100:00100000:2.0:1787868794.085305:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939596672 00000100:00100000:2.0:1787868794.085324:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939596928 00000100:00100000:2.0:1787868794.085327:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939596928 00000100:00100000:2.0:1787868794.085345:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787868794.085354:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1874715939596800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787868794.085464:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787868794.085468:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787868793 00002000:00010000:2.0:1787868794.085470:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787868794.085472:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787868793 -> 1787868793 00002000:00010000:2.0:1787868794.085474:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787868794.085520:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3639:x1874715939596800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (1075us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787868794.085526:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787868794.085674:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787868794.085680:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939596672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787868794.085701:0:8429:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1787868794.085718:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.085738:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 12 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.085747:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787868794.085751:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868794.085755:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.085798:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 12 pid: 8962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.085812:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 12 pid: 8962 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.085824:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1874715939597056:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868794.086291:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787868794.086315:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3638:x1874715939596928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787868794.086350:0:8431:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1787868794.086392:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a90b678, atime: 0x6a90b678, ctime: 0x6a90b678, blocks: 0x8 00010000:00010000:1.0:1787868794.086399:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.086433:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1787868794.086437:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868794.086445:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.086465:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.086477:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.086486:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.086524:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787868794.086742:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1874715939596928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 437us (1949us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787868794.086751:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787868794.086970:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868794.086980:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.086990:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868794.086995:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.087006:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.087027:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.087036:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be64f33d/0x2f11f4d3bde2e053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.087062:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868794.087064:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868794.087066:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868794.087183:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000004:00080000:1.0:1787868794.088092:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7fbe940/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787868794.088108:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939596928:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787868794.088284:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868794.088293:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787868794.088390:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9882dad00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787868794.088398:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939596800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787868794.094030:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.094130:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574208 00000100:00100000:1.0:1787868794.094142:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574208 00000100:00100000:1.0:1787868794.094241:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:1.0:1787868794.094267:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+13:2404:x1874715918574208:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787868794.094593:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.095295:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574336 00000100:00100000:1.0:1787868794.095308:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574336 00010000:00010000:1.0:1787868794.095364:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 14 pid: 8962 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.095407:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:1.0:1787868794.095418:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+14:2404:x1874715918574336:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868794.095437:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.095444:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 14 pid: 8962 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.095463:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 14 pid: 8962 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.095506:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787868794.095513:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787868794.095521:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.095535:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.095569:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868794.095660:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+14:2404:x1874715918574336:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 242us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.095687:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000001:00080000:3.0:1787868794.098805:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1787868794.098826:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787868794.100404:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2404:x1874715918574208:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 4881us (5233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.100436:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00010000:00010000:0.0:1787868794.101460:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c90888e5/0x2f11f4d3bde2de00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff25b expref: 7 pid: 8962 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.101493:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1874715939597056:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868794.101532:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.101572:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.101580:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.101593:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.101600:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.101639:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787868794.102959:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939596672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17269us (18392us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787868794.102977:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1787868794.103121:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868794.103132:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.103145:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868794.103150:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.103198:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.103227:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.103235:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e04c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.103266:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868794.103268:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868794.103270:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868794.104295:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787868794.104307:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1787868794.104386:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9882dad00, transno 4294967322 00000100:00100000:2.0:1787868794.104412:0:3637:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93d9882d83c0 x1874715939596672/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787868810 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787868794.104425:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9882d83c0/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787868794.104431:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939596672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787868794.113670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.114330:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574592 00000100:00100000:1.0:1787868794.114342:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574592 00000100:00100000:1.0:1787868794.114422:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1787868794.114439:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+21:12477:x1874715918574592:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787868794.114508:0:10190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.114539:0:10190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e037 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2f5 expref: 21 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.114561:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.114566:0:10190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868794.114597:0:10190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.114611:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.114619:0:10190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787868794.114771:0:10190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003955b404 reply state 00000000d253fd9e transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.114785:0:10190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.114792:0:10190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.114794:0:10190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787868794.114797:0:10190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787868794.114962:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+22:12477:x1874715918574592:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 529us (1301us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787868794.114970:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:3.0:1787868794.130581:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.131044:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574720 00000100:00100000:0.0:1787868794.131065:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574720 00000100:00100000:0.0:1787868794.131194:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1787868794.131210:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918574720:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787868794.131441:0:8962:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787868794.131446:0:8962:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787868793 -> 1787868793 00002000:00010000:0.0:1787868794.131449:0:8962:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787868792 00002000:00010000:0.0:1787868794.131452:0:8962:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787868793 -> 1787868793 00002000:00010000:0.0:1787868794.131455:0:8962:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787868794.131578:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918574720:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 372us (1006us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787868794.131587:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:3.0:1787868794.139927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.140115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918574976 00000100:00100000:2.0:1787868794.140136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918574976 00000100:00100000:2.0:1787868794.140292:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1787868794.140306:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+22:12477:x1874715918574976:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787868794.140416:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.140438:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.140448:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.140496:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.140522:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 22 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.140539:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939597184:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868794.140669:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868794.151852:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939597184:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868794.152981:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.153379:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575104 00000100:00100000:1.0:1787868794.153414:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575104 00010000:00010000:1.0:1787868794.153471:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.153515:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:1.0:1787868794.153526:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+23:2404:x1874715918575104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868794.153546:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.153553:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153569:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153597:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031000/0x2f11f4d3bde2e01b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2e7 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153618:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.153625:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153637:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153646:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.153668:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868794.153745:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+22:2404:x1874715918575104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 221us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.153772:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00010000:00010000:2.0:1787868794.154444:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154460:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154467:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154516:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154524:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154531:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154537:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.154543:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154552:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154565:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:2.0:1787868794.154568:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787868794.154574:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.154580:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e061 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.154674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+21:12477:x1874715918574976:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 14366us (14752us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787868794.154683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:1.0:1787868794.162381:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.162456:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575232 00000100:00100000:2.0:1787868794.162470:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575232 00000100:00100000:2.0:1787868794.162549:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1787868794.162562:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918575232:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787868794.162629:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.162659:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.162670:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868794.162676:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787868794.162681:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.162729:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.162746:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 8 pid: 8430 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.162775:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939597312:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868794.162923:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868794.166044:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1874715939597312:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868794.166086:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.171903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.172489:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575360 00000100:00100000:0.0:1787868794.172512:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575360 00010000:00010000:0.0:1787868794.172578:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 9 pid: 8430 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.172631:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:0.0:1787868794.172657:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+9:2403:x1874715918575360:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868794.172679:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868794.172718:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 9 pid: 8430 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.172738:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 9 pid: 8430 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.172793:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067092920/0x2f11f4d3bde2e045 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff303 expref: 9 pid: 8430 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.172820:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868794.172825:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868794.172832:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.172846:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.173451:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868794.173986:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+8:2403:x1874715918575360:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1338us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868794.173998:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00010000:00010000:1.0:1787868794.174099:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174114:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174146:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174187:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174198:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174206:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868794.174211:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174222:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174241:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.174265:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d514a8/0x2f11f4d3bde2e068 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.174331:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:666039a7-1461-4e99-8c4e-10237114565a+7:2403:x1874715918575232:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 11771us (11965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.174340:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1787868794.183828:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.184004:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575616 00000100:00100000:0.0:1787868794.184017:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575616 00000100:00100000:0.0:1787868794.184109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1787868794.184122:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+21:12477:x1874715918575616:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787868794.184281:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.184304:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.184315:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.184364:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.184379:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 21 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.184396:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597440:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868794.184500:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787868794.188230:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597440:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868794.188294:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868794.190258:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.191288:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575744 00000100:00100000:1.0:1787868794.191304:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575744 00010000:00010000:0.0:1787868794.191477:0:7463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.191644:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:0.0:1787868794.191672:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+22:2404:x1874715918575744:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868794.191696:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868794.191829:0:7463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191846:0:7463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191889:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870000/0x2f11f4d3bde2df5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2af expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191912:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:0.0:1787868794.191919:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191940:0:7463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191949:0:7463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.191982:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.192082:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868794.192218:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:666039a7-1461-4e99-8c4e-10237114565a+21:2404:x1874715918575744:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 551us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868794.192228:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00010000:00010000:2.0:1787868794.194015:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194037:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194318:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194337:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194348:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194399:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.194420:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 21 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.194439:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597568:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868794.195583:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868794.200639:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.201558:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597568:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868794.201602:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.201890:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918575872 00000100:00100000:1.0:1787868794.201900:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918575872 00010000:00010000:1.0:1787868794.202116:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 22 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.202198:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:1.0:1787868794.202210:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+22:2404:x1874715918575872:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868794.202230:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.202237:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 22 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202252:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 22 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202284:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2e029 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2ee expref: 22 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202304:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.202329:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202341:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202350:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.202385:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868794.202459:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+21:2404:x1874715918575872:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 251us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.202468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00010000:00010000:0.0:1787868794.202625:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.202633:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787868794.202809:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787868794.202956:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1787868794.202998:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1787868794.203100:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874715939597696:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787868794.203219:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868794.203253:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868794.204129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939597696 00000100:00100000:1.0:1787868794.204140:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939597696 00000100:00100000:1.0:1787868794.204229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787868794.204241:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daadc60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1874715939597696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787868794.204389:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daadc60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1874715939597696:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.204397:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787868794.205403:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874715939597696:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787868794.206224:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787868794.206342:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874715939597824:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787868794.206423:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868794.206461:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9170c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787868794.206677:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939597824 00000100:00100000:3.0:1787868794.206687:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939597824 00000100:00100000:3.0:1787868794.206772:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787868794.206785:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1874715939597824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787868794.206987:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1874715939597824:12345-0@lo:1000:mdt00_001.0 Request processed in 204us (563us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787868794.206996:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787868794.208586:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874715939597824:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787868794.208669:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208682:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208691:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208923:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.208929:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208940:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208962:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:2.0:1787868794.208966:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868794.208971:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.208995:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e076 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209029:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209036:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209042:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209048:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.209051:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209057:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868794.209069:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868794.209077:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209090:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209101:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.209199:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868794.209217:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597952:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787868794.209326:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9170c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868794.212427:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874715939597952:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787868794.212472:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212487:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871800/0x2f11f4d3bde2dfb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212545:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212563:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212577:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212590:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212597:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212604:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212633:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.212638:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212646:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212660:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868794.212664:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868794.212668:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212674:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80031600/0x2f11f4d3bde2e07d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212684:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212691:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212709:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212715:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.212718:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212723:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212742:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868794.212744:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868794.212748:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.212786:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e06f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868794.213381:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868794.213389:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787868794.214069:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+24:12477:x1874715918575616:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 29939us (30246us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787868794.214086:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000020:00080000:2.0:1787868794.214094:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787868794.214616:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787868794.214632:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787868794.219863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868794.219917:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.220150:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918576256 00000100:00100000:2.0:1787868794.220202:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918576256 00000100:00100000:2.0:1787868794.220259:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918576128 00000100:00100000:2.0:1787868794.220263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918576128 00000100:00100000:2.0:1787868794.220283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1787868794.220294:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+25:12476:x1874715918576256:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:2.0:1787868794.220481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+25:12476:x1874715918576256:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 187us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868794.220492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1787868794.220534:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1787868794.220541:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e37c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+24:12477:x1874715918576128:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787868794.220864:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787868794.220907:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787868794.220949:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.220990:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.221004:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.221016:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.221023:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.221030:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.221068:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787868794.221143:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e37c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+26:12477:x1874715918576128:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 600us (1223us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787868794.221152:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:2.0:1787868794.221197:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787868794.221959:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868794.221971:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.221981:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868794.221986:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.221996:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.222028:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:1.0:1787868794.222031:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787868794.222037:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.222043:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030600/0x2f11f4d3bde2e084 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.222058:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868794.222060:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868794.222062:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868794.225300:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.225402:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918576512 00000100:00100000:1.0:1787868794.225416:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918576512 00000100:00100000:1.0:1787868794.225506:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:1.0:1787868794.225520:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+26:12476:x1874715918576512:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:1.0:1787868794.225786:0:10190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787868794.225898:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+26:12476:x1874715918576512:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 380us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.225908:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:0.0:1787868794.260600:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.261201:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918576640 00000100:00100000:2.0:1787868794.261215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918576640 00000100:00100000:0.0:1787868794.261412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:0.0:1787868794.261426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+26:12479:x1874715918576640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868794.261467:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868794.261543:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2e08b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff30a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261640:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261672:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261686:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261713:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261722:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261729:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261862:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261874:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261884:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261948:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868794.261976:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 27 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.261995:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939598080:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868794.262136:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868794.266906:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868794.267064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918576896 00000100:00100000:2.0:1787868794.267078:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918576896 00000100:00100000:2.0:1787868794.267208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1787868794.267221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+28:6176:x1874715918576896:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787868794.267633:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874715939598080:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787868794.267676:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868794.270590:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+29:6176:x1874715918576896:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 3353us (3682us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787868794.270612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1787868794.274886:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868794.275330:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918577024 00000100:00100000:1.0:1787868794.275345:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918577024 00010000:00010000:1.0:1787868794.275405:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 29 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868794.275489:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:1.0:1787868794.275502:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+29:2404:x1874715918577024:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868794.275527:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868794.275535:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 29 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275552:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 29 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275581:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2dfab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2cb expref: 29 pid: 13805 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275603:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868794.275610:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275620:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275628:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868794.275702:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868794.275796:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:666039a7-1461-4e99-8c4e-10237114565a+28:2404:x1874715918577024:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 295us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868794.275805:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00010000:00010000:2.0:1787868794.276195:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276207:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868794.276285:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787868794.276292:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868794.276320:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276338:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276351:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276358:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276365:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276371:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.276376:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276384:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276396:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:2.0:1787868794.276399:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868794.276405:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276412:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e092 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276443:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276450:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276455:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276460:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868794.276463:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276469:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276478:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93da83a5f100) 00010000:00010000:2.0:1787868794.276480:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868794.276484:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276490:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2e099 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276534:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2e08b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff30a expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276550:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff30a expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868794.276570:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868794.276572:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868794.276575:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287000, rc 0) 00000100:00100000:2.0:1787868794.276622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+27:12479:x1874715918576640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 15199us (16037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868794.276630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00000001:00080000:2.0:1787868794.410482:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787868794.410509:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:0.0:1787868794.979515:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787868795.219297:0:14655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787868795.219311:0:14655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787868795.219346:0:14655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787868795.219352:0:14655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787868795.234430:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868795.234440:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868795.234470:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787868795.234477:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868795.235078:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939598208:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868795.236543:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986e10540 going to sleep for 11 seconds 00000100:00100000:1.0:1787868795.244370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868795.244963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918577152 00000100:00100000:2.0:1787868795.244974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918577152 00000100:00100000:2.0:1787868795.245040:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:2.0:1787868795.245052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+28:12490:x1874715918577152:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787868795.245101:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787868795.245246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+28:12490:x1874715918577152:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 196us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868795.245255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:2.0:1787868795.245309:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1874715939598208:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868795.251345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868795.251450:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918577408 00000100:00100000:1.0:1787868795.251460:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918577408 00000100:00100000:1.0:1787868795.251507:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:1.0:1787868795.251516:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+27:12490:x1874715918577408:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787868795.251535:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868795.251555:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2e0a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff311 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.251656:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e0ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.251673:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.251687:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868795.251699:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787868795.252070:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2e0a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff311 expref: 30 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.252092:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e0ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff311 expref: 29 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.252101:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868795.252112:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868795.252116:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1c00, rc 0) 00000100:00100000:1.0:1787868795.252220:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+29:12490:x1874715918577408:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 703us (898us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787868795.252228:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:3.0:1787868795.261785:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868795.261863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868795.261931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918577664 00000100:00100000:1.0:1787868795.261942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918577664 00000100:00100000:1.0:1787868795.262002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:1.0:1787868795.262012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+29:12490:x1874715918577664:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787868795.262106:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262125:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262137:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262316:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262324:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262332:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262337:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868795.262342:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262360:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262374:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868795.262377:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787868795.262382:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868795.262388:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1800/0x2f11f4d3bde2e0bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868795.262500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+30:12490:x1874715918577664:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 489us (724us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787868795.262507:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:0.0:1787868795.262787:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918577792 00000100:00100000:0.0:1787868795.262793:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918577792 00000100:00100000:0.0:1787868795.262845:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868795.262853:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+30:2405:x1874715918577792:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868795.262865:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868795.262880:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e0ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff311 expref: 30 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868795.262893:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:0.0:1787868795.262897:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868795.262917:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:666039a7-1461-4e99-8c4e-10237114565a+29:2405:x1874715918577792:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 66us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868795.262924:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000040:00080000:0.0:1787868795.263652:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868795.263659:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868795.264405:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787868795.264417:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787868795.265945:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868795.266943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578048 00000100:00100000:0.0:1787868795.266955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578048 00000100:00100000:0.0:1787868795.267023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:0.0:1787868795.267034:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+29:12490:x1874715918578048:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787868795.267314:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+30:12490:x1874715918578048:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 282us (1383us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787868795.267338:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:1.0:1787868796.001433:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787868796.323276:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787868796.323286:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787868796.323310:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787868796.323322:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787868796.841459:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787868797.026656:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868797.091951:0:14706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787868797.091963:0:14706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868797.091996:0:14706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787868797.092005:0:14706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787868797.217535:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868797.217644:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.217726:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939598848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.217766:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.217825:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939599360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.217860:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.217892:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939599872:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.217922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.217950:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787868797.217956:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989055a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939598464:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218003:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218023:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939598976:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218070:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939599488:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218103:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939600000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218196:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939598592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218241:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939599104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218279:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939599616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218317:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868797.218322:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939598720:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939599232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939599744:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.218436:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598336 00000100:00100000:1.0:1787868797.218443:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598336 00000100:00100000:1.0:1787868797.218501:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787868797.218510:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939598336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868797.218550:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868797.218599:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939598336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.218608:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787868797.218639:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598976 00000100:00100000:1.0:1787868797.218644:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598976 00000100:00100000:1.0:1787868797.218666:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598720 00000100:00100000:1.0:1787868797.218669:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598720 00000100:00100000:1.0:1787868797.218682:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787868797.218688:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939598976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218738:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939598976:12345-0@lo:400:kworker.0 Request processed in 48us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.218745:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787868797.218757:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787868797.218763:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939598720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218793:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939598720:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.218799:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787868797.218815:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599360 00000100:00100000:1.0:1787868797.218818:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599360 00000100:00100000:1.0:1787868797.218839:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599872 00000100:00100000:1.0:1787868797.218841:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599872 00000100:00100000:1.0:1787868797.218853:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599488 00000100:00100000:1.0:1787868797.218856:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599488 00000100:00100000:1.0:1787868797.218867:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600000 00000100:00100000:1.0:1787868797.218869:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600000 00000100:00100000:1.0:1787868797.218882:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787868797.218888:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939599360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218928:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939599360:12345-0@lo:400:kworker.0 Request processed in 40us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.218934:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787868797.218947:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787868797.218954:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939599872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.218979:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939599872:12345-0@lo:400:kworker.0 Request processed in 27us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.218985:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787868797.218995:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787868797.219001:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939599488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219025:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939599488:12345-0@lo:400:kworker.0 Request processed in 24us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219031:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787868797.219040:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868797.219045:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1874715939600000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219095:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1874715939600000:12345-0@lo:400:kworker.0 Request processed in 42us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219101:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787868797.219124:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598848 00000100:00100000:1.0:1787868797.219127:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598848 00000100:00100000:1.0:1787868797.219145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598592 00000100:00100000:1.0:1787868797.219148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598592 00000100:00100000:1.0:1787868797.219201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599104 00000100:00100000:1.0:1787868797.219204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599104 00000100:00100000:1.0:1787868797.219217:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599616 00000100:00100000:1.0:1787868797.219220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599616 00000100:00100000:1.0:1787868797.219232:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599232 00000100:00100000:1.0:1787868797.219241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599232 00000100:00100000:1.0:1787868797.219258:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939599744 00000100:00100000:1.0:1787868797.219260:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939599744 00000100:00100000:1.0:1787868797.219275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787868797.219280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939598848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939598848:12345-0@lo:400:kworker.0 Request processed in 31us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787868797.219328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787868797.219334:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939598592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939598592:12345-0@lo:400:kworker.0 Request processed in 27us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787868797.219375:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787868797.219380:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939599104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939599104:12345-0@lo:400:kworker.0 Request processed in 33us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219419:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787868797.219431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787868797.219437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939599616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939599616:12345-0@lo:400:kworker.0 Request processed in 26us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787868797.219477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787868797.219482:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939599232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219506:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939599232:12345-0@lo:400:kworker.0 Request processed in 24us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787868797.219530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787868797.219536:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939599744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939599744:12345-0@lo:400:kworker.0 Request processed in 29us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.219570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787868797.219634:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939598720:0@lo:400:kworker.0 00010000:00080000:1.0:1787868797.219652:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813c3c0 x1874715939599232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868797.219664:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939599232:0@lo:400:kworker.0 00010000:00080000:1.0:1787868797.219674:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813d2c0 x1874715939599744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868797.219682:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939599744:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939598592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219715:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939599104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219724:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939599616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219769:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939598976:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219778:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787868797.219783:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1787868797.219811:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d988387840, transno 4294967308 00000004:00080000:1.0:1787868797.219827:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1787868797.219843:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7fbe940, transno 4294967311 00000100:00100000:1.0:1787868797.219856:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939599488:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219871:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939600000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219889:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868797.219899:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939598848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219911:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939599360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868797.219922:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939599872:0@lo:400:kworker.0 00000100:00100000:2.0:1787868797.220264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939598464 00000100:00100000:2.0:1787868797.220270:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939598464 00000100:00100000:2.0:1787868797.220311:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787868797.220330:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939598464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868797.220398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939598464:12345-0@lo:400:kworker.0 Request processed in 72us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868797.220405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:2.0:1787868797.220455:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868797.220460:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868797.220463:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868797.220465:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868797.220480:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868797.220501:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868797.220540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868797.220589:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600128 00000100:00100000:2.0:1787868797.220600:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600128 00000100:00100000:2.0:1787868797.220629:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787868797.220635:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868797.220663:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787868797.220717:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868797.220723:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787868797.220764:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868797.220803:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989055a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939598464:0@lo:400:kworker.0 00000100:00100000:0.0:1787868797.224657:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868797.224759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868797.224833:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600256 00000100:00100000:0.0:1787868797.224841:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600256 00000100:00100000:0.0:1787868797.224888:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787868797.224898:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868797.224923:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868797.224967:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868797.224974:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787868797.225021:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868797.271196:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868797.271317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578304 00000100:00100000:1.0:1787868797.271625:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578304 00000100:00100000:1.0:1787868797.272008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:1.0:1787868797.272019:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+30:12511:x1874715918578304:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787868797.272048:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868797.272070:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2e0c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff318 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868797.272218:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e0ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868797.272235:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e0ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868797.272251:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e0ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868797.272264:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787868797.272387:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2e0c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff318 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868797.272419:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e0ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff318 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868797.272428:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:1.0:1787868797.272431:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787868797.272434:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0a00, rc 0) 00000100:00100000:1.0:1787868797.272493:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+32:12511:x1874715918578304:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 476us (1308us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787868797.272501:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00080000:2.0:1787868797.278275:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868797.280975:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868797.281021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578432 00000100:00100000:2.0:1787868797.281031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578432 00000100:00100000:2.0:1787868797.281096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:2.0:1787868797.281108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+32:12511:x1874715918578432:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1787868797.281227:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281248:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281262:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281305:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281314:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281321:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281328:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868797.281333:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281342:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281357:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:2.0:1787868797.281361:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868797.281366:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868797.281374:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030a00/0x2f11f4d3bde2e0d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868797.281461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+32:12511:x1874715918578432:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 354us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868797.281471:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:1.0:1787868797.401013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868797.401940:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578560 00000100:00100000:0.0:1787868797.401952:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578560 00000100:00100000:0.0:1787868797.402040:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1787868797.402052:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2405:x1874715918578560:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1787868797.402072:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868797.402109:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004612b5c2/0x2f11f4d3bde2e0df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff31f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868797.402545:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a90b679, atime: 0x6a90b678, ctime: 0x6a90b679, blocks: 0x8 00010000:00010000:0.0:1787868797.402569:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1787868797.402574:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868797.402586:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004612b5c2/0x2f11f4d3bde2e0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff31f expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868797.402604:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004612b5c2/0x2f11f4d3bde2e0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff31f expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868797.402617:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868797.402830:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2405:x1874715918578560:12345-192.168.204.27@tcp:101:cat.0 Request processed in 780us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868797.402838:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00080000:3.0:1787868797.404029:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868797.414541:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868797.415552:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578688 00000100:00100000:0.0:1787868797.415568:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578688 00002000:00100000:0.0:1787868797.415637:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93d9882d8b40 x1874715918578688/t0(0) o3->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1787868808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868797.415649:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9882d8b40 with x1874715918578688 ext(0->4095) 00002000:00010000:0.0:1787868797.415655:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9882d8b40 00000100:00100000:0.0:1787868797.415756:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1787868797.415768:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2405:x1874715918578688:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:0.0:1787868797.416001:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:666039a7-1461-4e99-8c4e-10237114565a+8:2405:x1874715918578688:12345-192.168.204.27@tcp:3:cat.0 Request processed in 235us (1470us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787868797.416025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00002000:00100000:0.0:1787868797.416032:0:8434:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93d9882d8b40 x1874715918578688/t0(0) o3->666039a7-1461-4e99-8c4e-10237114565a@192.168.204.27@tcp:118/0 lens 488/4536 e 0 to 0 dl 1787868808 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787868797.416039:0:8434:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9882d8b40 with x1874715918578688 ext(0->4095) 00002000:00010000:0.0:1787868797.416042:0:8434:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9882d8b40 00000100:00100000:2.0:1787868797.731966:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939600384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868797.732057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868797.732332:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600384 00000100:00100000:3.0:1787868797.732341:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600384 00000100:00100000:3.0:1787868797.732395:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787868797.732406:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939600384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868797.732441:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868797.732491:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939600384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868797.732499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787868797.733074:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939600512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868797.733115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868797.733301:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600512 00000100:00100000:1.0:1787868797.733307:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600512 00000100:00100000:1.0:1787868797.733356:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787868797.733365:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939600512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868797.733387:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787868797.733433:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939600512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868797.733439:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787868797.733483:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939600512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868797.733654:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939600384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868797.736800:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868797.738311:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939600640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868797.738590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868797.739023:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600640 00000100:00100000:0.0:1787868797.739033:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600640 00000100:00100000:0.0:1787868797.739099:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787868797.739110:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874715939600640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868797.739140:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868797.739222:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874715939600640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868797.739230:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787868797.739529:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939600640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787868798.051342:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868798.175098:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868798.175145:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868798.175492:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578816 00000100:00100000:0.0:1787868798.175504:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578816 00000100:00100000:0.0:1787868798.175638:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 397 00000100:00100000:0.0:1787868798.175649:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918578816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868798.175737:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918578816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868798.175745:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 397 00000100:00100000:1.0:1787868798.176026:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868798.176197:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868798.176223:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868798.176247:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579328 00000100:00100000:1.0:1787868798.176265:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579328 00000100:00100000:1.0:1787868798.176306:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918578944 00000100:00100000:1.0:1787868798.176309:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918578944 00000100:00100000:1.0:1787868798.176326:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579200 00000100:00100000:1.0:1787868798.176329:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579200 00000100:00100000:1.0:1787868798.176345:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:1.0:1787868798.176353:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918579328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868798.176400:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918579328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 48us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868798.176406:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:1.0:1787868798.176419:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 374 00000100:00100000:1.0:1787868798.176425:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918578944:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868798.176450:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918578944:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868798.177344:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579072 00000100:00100000:2.0:1787868798.177355:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579072 00000100:00100000:2.0:1787868798.177406:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:2.0:1787868798.177414:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868798.177476:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 63us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868798.177484:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:2.0:1787868798.177513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00100000:2.0:1787868798.177521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918579200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868798.177549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918579200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868798.177556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00080000:2.0:1787868798.177804:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868798.177810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868798.177814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868798.178440:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 374 00010000:00010000:1.0:1787868799.073907:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787868799.784979:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1787868799.785027:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d9870e8780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787868799.785033:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013fb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d9870e8f00 00000020:00080000:3.0:1787868799.785037:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab013f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d987efc800 00000020:00080000:3.0:1787868799.785068:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787868799.785783:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787868799.785871:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787868799.789118:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789140:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789206:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789213:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868799.789218:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789226:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789244:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93dab5bab100) 00010000:00010000:0.0:1787868799.789248:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868799.789254:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868799.789261:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e05a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868799.789455:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1787868799.789466:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1787868800.097468:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868801.121373:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868802.146527:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868802.351767:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868802.351867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.351966:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600768 00000100:00100000:0.0:1787868802.351977:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600768 00000100:00100000:0.0:1787868802.352048:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787868802.352059:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868802.352098:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868802.352152:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939600768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.352216:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787868802.352243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868802.352292:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939600768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868802.352441:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868802.352454:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939600896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868802.352497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.352532:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939600896 00000100:00100000:3.0:1787868802.352542:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939600896 00000100:00100000:3.0:1787868802.352574:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787868802.352581:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939600896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868802.352622:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787868802.352663:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939600896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.352670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787868802.352702:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939600896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868802.359855:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868802.359966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.360307:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939601408:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.360377:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939601920:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.360427:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787868802.360434:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939601536:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.360479:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939602048:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.360551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601408 00000100:00100000:0.0:1787868802.360561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601408 00000100:00100000:0.0:1787868802.360639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601920 00000100:00100000:0.0:1787868802.360642:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601920 00000100:00100000:0.0:1787868802.360675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602048 00000100:00100000:0.0:1787868802.360678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602048 00000100:00100000:0.0:1787868802.360698:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787868802.360709:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939601408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939601408:12345-0@lo:400:kworker.0 Request processed in 65us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.360780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787868802.360801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787868802.360808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939601920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360859:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939601920:12345-0@lo:400:kworker.0 Request processed in 51us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.360865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787868802.360877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787868802.360883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939602048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.360915:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939602048:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.360921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787868802.360945:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601536 00000100:00100000:0.0:1787868802.360949:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601536 00000100:00100000:0.0:1787868802.360978:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787868802.360984:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939601536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.361019:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939601536:12345-0@lo:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.361025:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1787868802.361462:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868802.361470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868802.361509:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939601536:0@lo:400:kworker.0 00010000:00080000:0.0:1787868802.361528:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0d2c0 x1874715939602048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868802.361539:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939602048:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.361553:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939601408:0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.361564:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939601920:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.361735:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939601152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.361794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.361836:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939601664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.361866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.361886:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939602176:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.361913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.361938:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787868802.361946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939601280:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.361969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.361988:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939601792:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.362011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.362029:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939602304:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.362052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.362100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601152 00000100:00100000:3.0:1787868802.362106:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601152 00000100:00100000:3.0:1787868802.362189:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787868802.362199:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939601152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.362248:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939601152:12345-0@lo:400:kworker.0 Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.362255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787868802.362292:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602176 00000100:00100000:3.0:1787868802.362296:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602176 00000100:00100000:3.0:1787868802.362334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602304 00000100:00100000:3.0:1787868802.362338:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602304 00000100:00100000:3.0:1787868802.362363:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787868802.362370:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.362404:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939602176:12345-0@lo:400:kworker.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.362410:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787868802.362422:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787868802.362428:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.362456:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939602304:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.362462:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787868802.362499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601664 00000100:00100000:3.0:1787868802.362502:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601664 00000100:00100000:2.0:1787868802.365321:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601024 00000100:00100000:2.0:1787868802.365347:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601024 00000100:00100000:3.0:1787868802.368479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601280 00000100:00100000:3.0:1787868802.368503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601280 00000100:00100000:3.0:1787868802.368579:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939601792 00000100:00100000:3.0:1787868802.368583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939601792 00000100:00100000:0.0:1787868802.370260:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787868802.370315:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.370455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939601664:12345-0@lo:400:kworker.0 Request processed in 154us (8587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.370463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787868802.370499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787868802.370507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939601280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868802.370537:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939601280:12345-0@lo:400:kworker.0 Request processed in 31us (8567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.370543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787868802.372989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787868802.373013:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939601792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.373221:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939601792:12345-0@lo:400:kworker.0 Request processed in 216us (11208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.373249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:3.0:1787868802.373289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868802.373295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868802.373299:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868802.373302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868802.373368:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939601280:0@lo:400:kworker.0 00010000:00080000:3.0:1787868802.373388:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0ed00 x1874715939601792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868802.373401:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939601792:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.373416:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787868802.373423:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9882d83c0, transno 4294967323 00000004:00080000:3.0:1787868802.373447:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787868802.373478:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939602304:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.373494:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939601152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.373509:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939601664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868802.373523:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939602176:0@lo:400:kworker.0 00000100:00100000:2.0:1787868802.373801:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787868802.373816:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939601024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868802.373838:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868802.373903:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939601024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (13937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868802.373910:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787868802.378050:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868802.849458:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868802.849496:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939602432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868802.849619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868802.849731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602432 00000100:00100000:3.0:1787868802.849743:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602432 00000100:00100000:3.0:1787868802.849812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787868802.849825:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939602432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868802.849891:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787868802.849969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939602432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868802.849979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787868802.850038:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939602432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868802.850504:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868802.850560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.850623:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602560 00000100:00100000:0.0:1787868802.850628:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602560 00000100:00100000:0.0:1787868802.850667:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787868802.850676:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939602560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868802.850885:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868802.851035:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939602560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 359us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.851044:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787868802.853140:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868802.853197:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939602688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868802.853289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868802.853361:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602688 00000100:00100000:0.0:1787868802.853370:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602688 00000100:00100000:0.0:1787868802.853420:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787868802.853430:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939602688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868802.853468:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868802.853520:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939602688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868802.853528:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787868802.853607:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939602688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868802.857053:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939602560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787868803.170876:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868803.290079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290176:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290239:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290264:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290296:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868803.290329:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579584 00000100:00100000:1.0:1787868803.290360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579584 00000100:00100000:1.0:1787868803.290435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580096 00000100:00100000:1.0:1787868803.290439:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580096 00000100:00100000:1.0:1787868803.290453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579712 00000100:00100000:1.0:1787868803.290456:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579712 00000100:00100000:1.0:1787868803.290469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580224 00000100:00100000:1.0:1787868803.290471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580224 00000100:00100000:1.0:1787868803.290491:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 382 00000100:00100000:1.0:1787868803.290503:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:2406:x1874715918579584:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.290635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:2406:x1874715918579584:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 134us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.290645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 382 00000100:00100000:1.0:1787868803.290667:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:1.0:1787868803.290685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918580096:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.290713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918580096:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.290720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:1.0:1787868803.290732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 384 00000100:00100000:1.0:1787868803.290739:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579712:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.290764:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579712:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.290770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 384 00000100:00100000:1.0:1787868803.290786:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00100000:1.0:1787868803.290793:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918580224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.290817:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918580224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.290831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00100000:1.0:1787868803.290859:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579840 00000100:00100000:1.0:1787868803.290863:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579840 00000100:00100000:1.0:1787868803.290896:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579968 00000100:00100000:1.0:1787868803.290899:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579968 00000100:00100000:1.0:1787868803.290922:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1787868803.290929:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579840:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.290960:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918579840:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.290967:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1787868803.290980:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:1.0:1787868803.290985:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918579968:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868803.291011:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918579968:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868803.291017:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00080000:1.0:1787868803.291041:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868803.291046:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868803.291049:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868803.291052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868803.291869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918579456 00000100:00100000:0.0:1787868803.291881:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918579456 00000100:00100000:0.0:1787868803.291944:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 399 00000100:00100000:0.0:1787868803.291954:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918579456:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868803.292029:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918579456:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868803.292036:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 399 00000100:00100000:1.0:1787868803.527849:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868803.528101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580352 00000100:00100000:3.0:1787868803.528115:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580352 00000100:00100000:3.0:1787868803.528248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:3.0:1787868803.528261:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:12165:x1874715918580352:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787868803.528411:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:666039a7-1461-4e99-8c4e-10237114565a+18:12165:x1874715918580352:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 151us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868803.528420:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1787868803.534198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868803.537695:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580480 00000100:00100000:3.0:1787868803.537721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580480 00000100:00100000:3.0:1787868803.537834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:3.0:1787868803.537848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:12165:x1874715918580480:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787868803.538029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:666039a7-1461-4e99-8c4e-10237114565a+5:12165:x1874715918580480:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 183us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868803.538037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:2.0:1787868803.546804:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868803.547244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580736 00000100:00100000:3.0:1787868803.547259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580736 00000100:00100000:3.0:1787868803.547349:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1787868803.547363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+18:12165:x1874715918580736:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787868803.547939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+19:12165:x1874715918580736:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 575us (1148us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787868803.547971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1787868804.015095:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868804.015763:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580864 00000100:00100000:0.0:1787868804.015782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580864 00000100:00100000:0.0:1787868804.015891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:0.0:1787868804.015906:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:12968:x1874715918580864:12345-192.168.204.27@tcp:101:lsof.0 00010000:00010000:0.0:1787868804.015936:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868804.015967:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e0e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff326 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016076:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016094:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016111:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868804.016247:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868804.016252:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868804.016286:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016318:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2e0e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff326 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016345:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff326 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868804.016357:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:0.0:1787868804.016361:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868804.016367:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286e00, rc 0) 00000100:00100000:0.0:1787868804.016473:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:12968:x1874715918580864:12345-192.168.204.27@tcp:101:lsof.0 Request processed in 570us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868804.016481:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 257 00010000:00010000:0.0:1787868804.193403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868805.218809:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787868805.944555:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1787868805.944578:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787868805.945601:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787868805.945618:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787868806.049879:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787868806.241585:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787868806.561412:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787868806.561425:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787868806.561969:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787868806.561980:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787868807.265341:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868807.457569:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868807.457597:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939602816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868807.457701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868807.457782:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939603200:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.457809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868807.457824:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939603328:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.457829:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939603712:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.457849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868807.457875:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603200 00000100:00100000:1.0:1787868807.457879:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939604224:0@lo:400:kworker.0 00000100:00100000:3.0:1787868807.457882:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603200 00000100:00100000:1.0:1787868807.457898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868807.457924:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603712 00000100:00100000:1.0:1787868807.457925:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604224 00000100:00100000:3.0:1787868807.457928:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603712 00000100:00100000:1.0:1787868807.457928:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604224 00000100:00100000:3.0:1787868807.457957:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787868807.457966:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939603200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602816 00000100:00100000:0.0:1787868807.458007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602816 00000100:00100000:3.0:1787868807.458024:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939603200:12345-0@lo:400:kworker.0 Request processed in 59us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458034:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787868807.458041:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939602816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868807.458067:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787868807.458097:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939602944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868807.458102:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939602816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458108:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787868807.458125:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868807.458143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868807.458150:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939603456:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458187:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939603840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.458193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.458211:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939603968:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458228:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939604352:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.458238:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458257:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603840 00000100:00100000:0.0:1787868807.458260:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603840 00000100:00100000:2.0:1787868807.458273:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939604480:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458289:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603968 00000100:00100000:2.0:1787868807.458293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458293:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603968 00000100:00100000:0.0:1787868807.458305:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604480 00000100:00100000:0.0:1787868807.458307:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604480 00000100:00100000:2.0:1787868807.458311:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787868807.458317:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939603072:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458321:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787868807.458327:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939603840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.458341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458356:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939603840:12345-0@lo:400:kworker.0 Request processed in 29us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458362:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787868807.458363:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939603584:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458373:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868807.458378:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939603968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458403:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939603968:12345-0@lo:400:kworker.0 Request processed in 25us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458409:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868807.458421:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787868807.458426:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939604480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458467:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939604480:12345-0@lo:400:kworker.0 Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458473:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1787868807.458487:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868807.458508:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868807.458544:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939603200:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458559:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939602816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868807.458616:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603456 00000100:00100000:0.0:1787868807.458619:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603456 00000100:00100000:0.0:1787868807.458640:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787868807.458645:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458674:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939603456:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458679:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787868807.458696:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939602944 00000100:00100000:0.0:1787868807.458700:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939602944 00000100:00100000:0.0:1787868807.458722:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787868807.458728:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939602944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868807.458746:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868807.458774:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939602944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458781:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787868807.458804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.458831:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939603840:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458849:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604352 00000100:00100000:0.0:1787868807.458852:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604352 00000100:00100000:0.0:1787868807.458876:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787868807.458881:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458917:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939604352:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.458934:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1787868807.458949:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868807.458966:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939604352:0@lo:400:kworker.0 00000100:00100000:0.0:1787868807.458992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603328 00000100:00100000:0.0:1787868807.458996:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603328 00000100:00100000:2.0:1787868807.459007:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.459025:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939604096:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.459050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.459062:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939604608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868807.459080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.459112:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939602944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868807.459121:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939603456:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.459130:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939603968:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.459138:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939604480:0@lo:400:kworker.0 00000100:00100000:2.0:1787868807.459189:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604608 00000100:00100000:2.0:1787868807.459194:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604608 00000100:00100000:2.0:1787868807.459216:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868807.459222:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939604608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868807.459232:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868807.459285:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939604608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868807.459301:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868807.459333:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939604608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868807.459360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603584 00000100:00100000:2.0:1787868807.459363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603584 00000100:00100000:1.0:1787868807.459543:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604096 00000100:00100000:1.0:1787868807.459547:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604096 00000100:00100000:1.0:1787868807.459568:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787868807.459575:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939603712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.459621:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939603712:12345-0@lo:400:kworker.0 Request processed in 47us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868807.459626:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787868807.459640:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787868807.459645:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939604224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.459671:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939604224:12345-0@lo:400:kworker.0 Request processed in 27us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868807.459677:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787868807.459688:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787868807.459693:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939604096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.459726:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939604096:12345-0@lo:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868807.459742:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00080000:1.0:1787868807.459780:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988190f00 x1874715939603712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868807.459794:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939603712:0@lo:400:kworker.0 00010000:00080000:1.0:1787868807.459808:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9881930c0 x1874715939604224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868807.459817:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939604224:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.459845:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939604096:0@lo:400:kworker.0 00000100:00080000:1.0:1787868807.459871:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868807.467311:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787868807.467597:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939603072 00000100:00100000:3.0:1787868807.467609:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939603072 00000100:00100000:3.0:1787868807.467694:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1787868807.467707:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939603072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868807.467903:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939603072:12345-0@lo:400:kworker.0 Request processed in 200us (9560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868807.467911:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1787868807.467975:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939603072:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.469311:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787868807.469332:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939603328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.469812:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939603328:12345-0@lo:400:kworker.0 Request processed in 490us (11654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868807.469821:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787868807.470222:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939603328:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.473220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787868807.473251:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939603584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.473373:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939603584:12345-0@lo:400:kworker.0 Request processed in 140us (14990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868807.473381:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1787868807.474228:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939603584:0@lo:400:kworker.0 00000100:00100000:1.0:1787868807.969748:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939604736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868807.969835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.971817:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604736 00000100:00100000:2.0:1787868807.971832:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604736 00000100:00100000:2.0:1787868807.971903:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787868807.971915:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939604736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868807.971966:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787868807.972049:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939604736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868807.972057:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787868807.972298:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939604736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868807.972320:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868807.972345:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939604864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868807.972382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868807.972777:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604864 00000100:00100000:2.0:1787868807.972785:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604864 00000100:00100000:2.0:1787868807.972836:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787868807.972844:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939604864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868807.972863:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787868807.972929:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939604864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868807.972936:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787868807.973029:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939604864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868807.974422:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868807.974465:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939604992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868807.974534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868807.974644:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939604992 00000100:00100000:0.0:1787868807.974651:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939604992 00000100:00100000:0.0:1787868807.974702:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787868807.974711:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939604992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868807.974730:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868807.974784:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939604992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868807.974791:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787868807.974873:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939604992:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787868808.290371:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868808.409379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868808.409424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868808.409465:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868808.409508:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868808.409535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868808.409538:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581504 00000100:00100000:2.0:1787868808.409550:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581504 00000100:00100000:1.0:1787868808.409557:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868808.409583:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00080000:1.0:1787868808.409619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868808.409631:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581376 00000100:00100000:1.0:1787868808.409636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581248 00000100:00100000:2.0:1787868808.409637:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581376 00000100:00100000:1.0:1787868808.409642:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581248 00000100:00100000:2.0:1787868808.409679:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:1.0:1787868808.409688:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581760 00000100:00100000:1.0:1787868808.409693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581760 00000100:00100000:2.0:1787868808.409694:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918581504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868808.409711:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581120 00000100:00100000:1.0:1787868808.409714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581120 00000100:00100000:1.0:1787868808.409727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581632 00000100:00100000:1.0:1787868808.409729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581632 00000100:00100000:1.0:1787868808.409745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 392 00000100:00100000:1.0:1787868808.409752:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918581248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868808.409787:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+7:2406:x1874715918581504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 97us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868808.409792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918581248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868808.409822:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 392 00000100:00100000:3.0:1787868808.409889:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918580992 00000100:00100000:3.0:1787868808.409894:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918580992 00000100:00100000:2.0:1787868808.412850:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:1.0:1787868808.413028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 393 00000100:00100000:1.0:1787868808.413056:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918581760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868808.413149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2406:x1874715918581760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 109us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868808.413203:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:2.0:1787868808.413213:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918581376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868808.413246:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:666039a7-1461-4e99-8c4e-10237114565a+5:2406:x1874715918581376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868808.413252:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:3.0:1787868808.413276:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 401 00000100:00080000:2.0:1787868808.413279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868808.413285:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868808.413288:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868808.413295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918580992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868808.413518:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2406:x1874715918580992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 230us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868808.413526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 401 00000100:00100000:0.0:1787868808.414710:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 394 00000100:00100000:0.0:1787868808.414728:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+18:2406:x1874715918581120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868808.414795:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:666039a7-1461-4e99-8c4e-10237114565a+18:2406:x1874715918581120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868808.414803:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 394 00000100:00100000:0.0:1787868808.414829:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 395 00000100:00100000:0.0:1787868808.414837:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918581632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868808.414863:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2406:x1874715918581632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (5280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868808.414869:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 395 00000100:00100000:1.0:1787868808.417033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 393 00010000:00010000:1.0:1787868809.322709:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787868809.596690:0:14904:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:13:27 (1787868807) 00010000:00010000:3.0:1787868810.350014:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868811.371223:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868812.394787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868812.580185:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868812.580211:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868812.580284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868812.580817:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605120 00000100:00100000:2.0:1787868812.580827:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605120 00000100:00100000:2.0:1787868812.580892:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787868812.580903:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939605120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868812.580932:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787868812.580978:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939605120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868812.580985:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787868812.581286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868812.581326:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868812.581524:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868812.581535:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939605248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868812.581579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868812.581613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605248 00000100:00100000:0.0:1787868812.581617:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605248 00000100:00100000:0.0:1787868812.581647:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787868812.581654:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939605248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868812.581666:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868812.581713:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939605248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868812.581721:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1787868812.581736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868812.581755:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939605248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868812.582392:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939605632:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582473:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939606144:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582510:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939606656:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582566:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787868812.582572:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582600:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582622:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939606016:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582662:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939606528:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868812.582738:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606656 00000100:00100000:3.0:1787868812.582743:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606656 00000100:00100000:3.0:1787868812.582783:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787868812.582791:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939606656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582831:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939606656:12345-0@lo:400:kworker.0 Request processed in 42us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868812.582837:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787868812.582856:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605504 00000100:00100000:3.0:1787868812.582860:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605504 00000100:00100000:3.0:1787868812.582884:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787868812.582891:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582919:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3637:x1874715939605504:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868812.582926:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00080000:3.0:1787868812.582953:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868812.582974:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.582986:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939606656:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583254:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939605760:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583313:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939606272:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583347:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939606784:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583381:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868812.583387:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939605376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868812.583417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583435:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939605888:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583470:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989065680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939606400:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868812.583510:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606016 00000100:00100000:1.0:1787868812.583513:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606016 00000100:00100000:1.0:1787868812.583533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605760 00000100:00100000:1.0:1787868812.583536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605760 00000100:00100000:1.0:1787868812.583560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605376 00000100:00100000:1.0:1787868812.583570:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605376 00000100:00100000:1.0:1787868812.583587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787868812.583593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939606016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939606016:12345-0@lo:400:kworker.0 Request processed in 38us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.583636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787868812.583649:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787868812.583655:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939605760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939605760:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.583713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787868812.583726:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787868812.583732:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939605376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868812.583756:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787868812.583787:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939605376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.583793:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787868812.583826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605632 00000100:00100000:1.0:1787868812.583830:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605632 00000100:00100000:1.0:1787868812.583847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606144 00000100:00100000:1.0:1787868812.583850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606144 00000100:00100000:1.0:1787868812.583866:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606528 00000100:00100000:1.0:1787868812.583868:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606528 00000100:00100000:1.0:1787868812.583880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606272 00000100:00100000:1.0:1787868812.583882:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606272 00000100:00100000:1.0:1787868812.583894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939605888 00000100:00100000:1.0:1787868812.583897:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939605888 00000100:00100000:1.0:1787868812.583907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787868812.583913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939605632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.583949:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939605632:12345-0@lo:400:kworker.0 Request processed in 37us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.583955:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787868812.583965:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606400 00000100:00100000:1.0:1787868812.583968:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606400 00000100:00100000:1.0:1787868812.583984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787868812.583990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939606144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584017:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939606144:12345-0@lo:400:kworker.0 Request processed in 27us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.584022:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787868812.584032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787868812.584037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939606528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584066:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939606528:12345-0@lo:400:kworker.0 Request processed in 28us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.584071:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787868812.584082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787868812.584087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939606272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939606272:12345-0@lo:400:kworker.0 Request processed in 26us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.584119:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787868812.584131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787868812.584136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939605888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939605888:12345-0@lo:400:kworker.0 Request processed in 60us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.584202:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787868812.584220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787868812.584226:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939606400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939606400:12345-0@lo:400:kworker.0 Request processed in 29us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868812.584261:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787868812.584296:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939605376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868812.584308:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939605888:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584316:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989065680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939606400:0@lo:400:kworker.0 00000100:00100000:1.0:1787868812.584324:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939605760:0@lo:400:kworker.0 00010000:00080000:1.0:1787868812.584336:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989067480 x1874715939606272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868812.584347:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939606272:0@lo:400:kworker.0 00000100:00100000:0.0:1787868812.585494:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606784 00000100:00100000:0.0:1787868812.585504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606784 00000100:00100000:0.0:1787868812.585579:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787868812.585588:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939606784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868812.585661:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939606784:12345-0@lo:400:kworker.0 Request processed in 75us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868812.585668:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787868812.585895:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939606784:0@lo:400:kworker.0 00000100:00080000:3.0:1787868812.586064:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868812.586069:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868812.586072:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868812.586096:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939606016:0@lo:400:kworker.0 00010000:00080000:3.0:1787868812.586110:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989064f00 x1874715939606528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868812.586121:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939606528:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.586151:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939605632:0@lo:400:kworker.0 00000100:00100000:3.0:1787868812.586180:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939606144:0@lo:400:kworker.0 00000100:00100000:2.0:1787868813.089434:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868813.089457:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939606912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868813.089520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868813.089834:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939606912 00000100:00100000:3.0:1787868813.089841:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939606912 00000100:00100000:3.0:1787868813.089889:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787868813.089898:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939606912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868813.089932:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787868813.089973:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939606912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868813.089980:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787868813.090253:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939606912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868813.093086:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939607040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868813.093199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868813.093257:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868813.093264:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939607168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868813.093277:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607040 00000100:00100000:0.0:1787868813.093284:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607040 00000100:00100000:2.0:1787868813.093289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868813.093328:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787868813.093338:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939607040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868813.093358:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868813.093415:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939607040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868813.093439:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787868813.093481:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939607040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868813.094851:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607168 00000100:00100000:1.0:1787868813.094860:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607168 00000100:00100000:1.0:1787868813.094919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787868813.094928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939607168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868813.094967:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868813.095045:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939607168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868813.095053:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787868813.096902:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939607168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787868813.409846:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868813.531297:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868813.531394:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868813.531433:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868813.533445:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582144 00000100:00100000:1.0:1787868813.533461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582144 00000100:00100000:1.0:1787868813.533565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582016 00000100:00100000:1.0:1787868813.533569:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582016 00000100:00100000:1.0:1787868813.533620:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 402 00000100:00100000:1.0:1787868813.533632:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918582144:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868813.533712:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2403:x1874715918582144:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 84us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868813.533720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 402 00000100:00100000:1.0:1787868813.533737:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 403 00000100:00100000:1.0:1787868813.533745:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+18:2403:x1874715918582016:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868813.533772:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+18:2403:x1874715918582016:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868813.533778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 403 00000100:00080000:0.0:1787868813.533861:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868813.533865:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868813.539306:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918581888 00000100:00100000:3.0:1787868813.539322:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918581888 00000100:00100000:3.0:1787868813.539405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 403 00000100:00100000:3.0:1787868813.539417:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918581888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868813.539535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fecd04dc-e32d-4648-8add-7b218bbcda4e+13:2403:x1874715918581888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 120us (8246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868813.539543:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 403 00000100:00100000:0.0:1787868813.543223:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868813.543261:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868813.543296:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868813.543427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582528 00000100:00100000:1.0:1787868813.543436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582528 00000100:00100000:1.0:1787868813.543520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 404 00000100:00100000:1.0:1787868813.543530:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2403:x1874715918582528:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868813.543596:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2403:x1874715918582528:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868813.543603:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 404 00000100:00080000:1.0:1787868813.543638:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868813.543802:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582272 00000100:00100000:2.0:1787868813.543807:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582272 00000100:00100000:2.0:1787868813.543852:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582400 00000100:00100000:2.0:1787868813.543855:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582400 00000100:00100000:2.0:1787868813.543878:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1787868813.543886:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918582400:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868813.543916:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2404:x1874715918582400:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868813.543923:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1787868813.543937:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:2.0:1787868813.543944:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918582272:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1787868813.543961:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d3e2 00000100:00080000:2.0:1787868813.543970:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93daa072e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868813.544010:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787868813.544176:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+2:2402:x1874715918582272:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 210us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868813.544185:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00080000:1.0:1787868813.544479:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868813.544483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787868813.544634:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868813.545851:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868813.546110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582656 00000100:00100000:1.0:1787868813.546118:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582656 00000100:00100000:1.0:1787868813.546206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 405 00000100:00100000:1.0:1787868813.546215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918582656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868813.546287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2404:x1874715918582656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 73us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868813.546306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 405 00000100:00080000:0.0:1787868813.548904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787868814.436095:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868815.026580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868815.026914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918582912 00000100:00100000:0.0:1787868815.026925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918582912 00000100:00100000:0.0:1787868815.027045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1787868815.027058:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+18:13193:x1874715918582912:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:0.0:1787868815.027367:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+19:13193:x1874715918582912:12345-192.168.204.27@tcp:35:umount.0 Request processed in 311us (797us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787868815.027375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00080000:1.0:1787868815.027434:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868815.040314:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868815.045210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918583168 00000100:00100000:0.0:1787868815.045229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918583168 00000100:00100000:0.0:1787868815.045315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868815.045327:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+19:13193:x1874715918583168:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:0.0:1787868815.045717:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+20:13193:x1874715918583168:12345-192.168.204.27@tcp:35:umount.0 Request processed in 391us (5413us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787868815.045725:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1787868815.062658:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868815.062805:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918583424 00000100:00100000:0.0:1787868815.062815:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918583424 00000100:00100000:0.0:1787868815.062874:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1787868815.062885:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daa7e36050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+20:13193:x1874715918583424:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:0.0:1787868815.063272:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daa7e36050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:666039a7-1461-4e99-8c4e-10237114565a+21:13193:x1874715918583424:12345-192.168.204.27@tcp:35:umount.0 Request processed in 389us (623us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787868815.063282:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1787868815.068477:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868815.068804:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918583680 00000100:00100000:3.0:1787868815.068815:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918583680 00000100:00100000:3.0:1787868815.068876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1787868815.068887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+21:13193:x1874715918583680:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:3.0:1787868815.069368:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:666039a7-1461-4e99-8c4e-10237114565a+22:13193:x1874715918583680:12345-192.168.204.27@tcp:35:umount.0 Request processed in 481us (911us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787868815.069377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1787868815.078733:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868815.078865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868815.082866:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868815.086510:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918583808 00000100:00100000:0.0:1787868815.086526:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918583808 00000100:00100000:0.0:1787868815.086827:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918584064 00000100:00100000:0.0:1787868815.086832:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918584064 00000100:00100000:3.0:1787868815.086854:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868815.086869:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787868815.086873:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+14:2405:x1874715918583808:12345-192.168.204.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787868815.086883:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+14:2405:x1874715918584064:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868815.086894:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868815.086894:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868815.086919:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20fe200/0x2f11f4d3bde2d0c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee79 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868815.086920:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2d2df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef52 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868815.086947:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868815.086948:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868815.087028:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:2405:x1874715918584064:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 149us (8162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868815.087036:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787868815.089767:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2405:x1874715918583808:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2889us (11032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868815.089783:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787868815.089817:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918583936 00000100:00100000:3.0:1787868815.089825:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918583936 00000100:00100000:3.0:1787868815.089875:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787868815.089883:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2405:x1874715918583936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868815.089895:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868815.091883:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870600/0x2f11f4d3bde2d007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee3a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.091902:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868815.091967:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2405:x1874715918583936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2084us (9113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868815.091976:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1787868815.093455:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868815.093710:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918584448 00000100:00100000:3.0:1787868815.093731:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918584448 00000100:00100000:3.0:1787868815.093842:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1787868815.093853:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+7:2402:x1874715918584448:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:3.0:1787868815.093884:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d658 00000020:00010000:3.0:1787868815.093892:0:8429:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93daa072c000: total 0 00000100:00080000:3.0:1787868815.093897:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93daa072f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787868815.093954:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787868815.094132:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918584448:12345-192.168.204.27@tcp:9:umount.0 Request processed in 280us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868815.094140:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000020:00010000:0.0:1787868815.096919:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93daa072c000: total 0 00010000:00010000:0.0:1787868815.097016:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93daa072c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787868815.097094:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004612b5c2/0x2f11f4d3bde2e0df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff31f expref: 4 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868815.097143:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2da10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff13c expref: 3 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868815.097199:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93daa072c000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787868815.097215:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868815.097218:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868815.097220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868815.105211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868815.139995:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868815.140862:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918585472 00000100:00100000:2.0:1787868815.140876:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918585472 00000100:00100000:2.0:1787868815.140986:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:2.0:1787868815.140998:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+22:2402:x1874715918585472:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:2.0:1787868815.141041:0:13805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d015 00000020:00010000:2.0:1787868815.141059:0:13805:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab7ed9000: total 0 00000100:00080000:2.0:1787868815.141064:0:13805:0:(import.c:65:import_set_state_nolock()) ffff93dab7ede800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868815.141094:0:13805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1787868815.141287:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:666039a7-1461-4e99-8c4e-10237114565a+21:2402:x1874715918585472:12345-192.168.204.27@tcp:39:umount.0 Request processed in 291us (1301us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787868815.141295:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 258 00000020:00010000:3.0:1787868815.142920:0:7921:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab7ed9000: total 0 00010000:00010000:3.0:1787868815.142986:0:7921:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab7ed9000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787868815.143036:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868815.143041:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787868815.143051:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93da80030800/0x2f11f4d3bde2da95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff15f expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143076:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93dab5b3ff00) 00010000:00010000:3.0:1787868815.143079:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868815.143083:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2d341 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef60 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143102:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868815.143105:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868815.143109:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287000/0x2f11f4d3bde2e0a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff30a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143122:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868815.143136:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868815.143142:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d600/0x2f11f4d3bde2d8f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff0ef expref: 17 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143202:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:3.0:1787868815.143205:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868815.143209:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286400/0x2f11f4d3bde2da79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff158 expref: 16 pid: 10190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143222:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868815.143225:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787868815.143228:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e0ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff318 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143241:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868815.143244:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787868815.143247:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b400/0x2f11f4d3bde2d3b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef7c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143264:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868815.143267:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868815.143270:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2d9d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff127 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143282:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93daafdb5700) 00010000:00010000:3.0:1787868815.143284:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787868815.143288:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2dd82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff238 expref: 12 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143316:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93da83a5f300) 00010000:00010000:3.0:1787868815.143319:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787868815.143323:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a800/0x2f11f4d3bde2d6b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff055 expref: 11 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143339:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da88316000) 00010000:00010000:3.0:1787868815.143342:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868815.143345:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ca00/0x2f11f4d3bde2d35d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef67 expref: 10 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143376:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93da99ffb300) 00010000:00010000:3.0:1787868815.143379:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787868815.143383:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870a00/0x2f11f4d3bde2dfc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff2d2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143398:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93dabc0a2200) 00010000:00010000:3.0:1787868815.143400:0:7921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787868815.143404:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2d9fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff135 expref: 8 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868815.143417:0:7921:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab7ed9000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787868815.143432:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868815.143434:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868815.143436:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868815.159258:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868815.159445:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918585600 00000100:00100000:1.0:1787868815.159457:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918585600 00000100:00100000:1.0:1787868815.159547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 259 00000100:00100000:1.0:1787868815.159558:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+5:2402:x1874715918585600:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1787868815.159605:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d01c 00000100:00080000:1.0:1787868815.159626:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dab7edc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868815.159652:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787868815.159829:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:666039a7-1461-4e99-8c4e-10237114565a+3:2402:x1874715918585600:12345-192.168.204.27@tcp:39:umount.0 Request processed in 272us (581us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787868815.159837:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 259 00010000:00010000:1.0:1787868815.159859:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787868815.160251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787868815.457742:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787868816.290118:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868816.482910:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787868816.801497:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787868816.801508:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868816.804479:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787868816.804499:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787868817.505361:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868817.697390:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939607424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868817.697466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.697544:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939607808:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.697570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.697595:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939608320:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.697617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.697649:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939608832:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.697669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.697688:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787868817.697862:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939607680:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.697897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.697923:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939608192:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.697947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.697966:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939608704:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.697988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.698001:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939607296:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.698010:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787868817.698020:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939607552:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.698038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868817.698174:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607808 00000100:00100000:0.0:1787868817.698182:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607808 00000100:00100000:0.0:1787868817.698226:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608192 00000100:00100000:0.0:1787868817.698229:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608192 00000100:00100000:0.0:1787868817.698255:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608704 00000100:00100000:0.0:1787868817.698258:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608704 00000100:00100000:0.0:1787868817.698274:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787868817.698283:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939607808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868817.698756:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939609088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868817.701921:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.701978:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939608064:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.702014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.702032:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939608576:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.702075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.702108:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939609216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868817.702138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.702223:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608320 00000100:00100000:2.0:1787868817.702233:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608320 00000100:00100000:2.0:1787868817.702286:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608832 00000100:00100000:2.0:1787868817.702290:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608832 00000100:00100000:2.0:1787868817.702325:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787868817.702336:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939608320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.702387:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939608320:12345-0@lo:400:kworker.0 Request processed in 54us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.704004:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787868817.704027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607680 00000100:00100000:1.0:1787868817.704035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607680 00000100:00100000:2.0:1787868817.704044:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787868817.704057:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939608832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.704083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609216 00000100:00100000:1.0:1787868817.704088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609216 00000100:00100000:1.0:1787868817.704108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787868817.704117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939607680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.704125:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939608832:12345-0@lo:400:kworker.0 Request processed in 72us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.704132:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787868817.704177:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787868817.704187:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939609216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868817.704214:0:7741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787868817.704248:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1874715939609216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.704254:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787868817.704275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607552 00000100:00100000:2.0:1787868817.704278:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607552 00000100:00100000:2.0:1787868817.704296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608064 00000100:00100000:2.0:1787868817.704323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608064 00000100:00100000:2.0:1787868817.704341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608576 00000100:00100000:2.0:1787868817.704343:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608576 00000100:00100000:2.0:1787868817.704361:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787868817.704367:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939608192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.705941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939607680:12345-0@lo:400:kworker.0 Request processed in 70us (6287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.705958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787868817.705960:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939608192:12345-0@lo:400:kworker.0 Request processed in 1589us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.705971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787868817.705999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1787868817.706004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607296 00000100:00100000:1.0:1787868817.706011:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607296 00000100:00100000:2.0:1787868817.706012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939608704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706058:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787868817.706068:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706080:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939608704:12345-0@lo:400:kworker.0 Request processed in 74us (8090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.706087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1787868817.706104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787868817.706113:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939607552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3638:x1874715939607296:12345-0@lo:400:kworker.0 Request processed in 48us (8076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706125:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787868817.706175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939607552:12345-0@lo:400:kworker.0 Request processed in 46us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.706183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787868817.706202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1787868817.706211:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939607296:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939608064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706231:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939607936:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939608064:12345-0@lo:400:kworker.0 Request processed in 46us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868817.706261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1787868817.706275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.706279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1787868817.706286:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939608576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706320:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939608448:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706335:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939608576:12345-0@lo:400:kworker.0 Request processed in 48us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868817.706357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787868817.706379:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939608960:0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706387:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608448 00000100:00100000:2.0:1787868817.706393:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608448 00000100:00100000:1.0:1787868817.706405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868817.706431:0:8962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939608960 00000100:00100000:1.0:1787868817.706442:0:8962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939608960 00000100:00100000:2.0:1787868817.706446:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868817.706458:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939608448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706471:0:8962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787868817.706480:0:8962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939608960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868817.706512:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939608448:12345-0@lo:400:kworker.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706523:0:8962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939608960:12345-0@lo:400:kworker.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706529:0:8962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787868817.706555:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939608960:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706567:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939608320:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706577:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939608832:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706603:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939608448:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706647:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607424 00000100:00100000:1.0:1787868817.706650:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607424 00000100:00100000:1.0:1787868817.706681:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787868817.706688:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939607424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868817.706708:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787868817.706744:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939607424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (9278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706750:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787868817.706778:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939607424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787868817.706801:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868817.706805:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868817.706808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868817.706809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868817.706839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939607936 00000100:00100000:1.0:1787868817.706842:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939607936 00000100:00100000:1.0:1787868817.706864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787868817.706877:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939607936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939607936:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868817.706918:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787868817.706954:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939609216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868817.706967:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939607552:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706978:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939608064:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706988:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939608576:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.706996:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939607680:0@lo:400:kworker.0 00010000:00080000:1.0:1787868817.707010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f57c00 x1874715939608192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868817.707021:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939608192:0@lo:400:kworker.0 00010000:00080000:1.0:1787868817.707032:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f94b40 x1874715939608704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868817.707041:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939608704:0@lo:400:kworker.0 00000100:00100000:1.0:1787868817.707078:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939607936:0@lo:400:kworker.0 00000100:00100000:0.0:1787868817.707845:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939607808:12345-0@lo:400:kworker.0 Request processed in 9559us (10269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868817.707854:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1787868817.708294:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787868817.708539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939607808:0@lo:400:kworker.0 00000100:00100000:3.0:1787868817.715146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868817.718820:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609088 00000100:00100000:0.0:1787868817.718835:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609088 00000100:00100000:0.0:1787868817.718901:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787868817.718911:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939609088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868817.718939:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868817.719125:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939609088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 215us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868817.719132:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787868817.727205:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939609088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868818.210072:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868818.210099:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939609344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868818.210199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868818.210582:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609344 00000100:00100000:1.0:1787868818.210591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609344 00000100:00100000:1.0:1787868818.210653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787868818.210663:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939609344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868818.210715:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787868818.210849:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939609344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 186us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.210856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787868818.211109:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868818.211121:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939609472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868818.211178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868818.211770:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939609344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868818.213807:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609472 00000100:00100000:1.0:1787868818.213817:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609472 00000100:00100000:1.0:1787868818.213870:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787868818.213879:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939609472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868818.213914:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787868818.214008:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939609472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.214017:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787868818.214672:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868818.214703:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939609600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868818.214763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868818.214820:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609600 00000100:00100000:0.0:1787868818.214825:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609600 00000100:00100000:0.0:1787868818.214865:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787868818.214874:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939609600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868818.214888:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787868818.214923:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939609600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868818.214942:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787868818.214987:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939609600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868818.218045:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939609472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868818.473022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868818.473081:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868818.473118:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868818.473203:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918585728 00000100:00100000:1.0:1787868818.473212:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918585728 00000100:00100000:1.0:1787868818.473270:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918585984 00000100:00100000:1.0:1787868818.473274:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918585984 00000100:00100000:1.0:1787868818.473300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918585856 00000100:00100000:1.0:1787868818.473303:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918585856 00000100:00100000:1.0:1787868818.473320:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1787868818.473329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+12:2403:x1874715918585728:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868818.473344:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868818.473363:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2d118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee8e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868818.473381:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868818.473431:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+11:2403:x1874715918585728:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 103us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.473438:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1787868818.473470:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1787868818.473475:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+10:2403:x1874715918585984:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868818.473484:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868818.473493:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2d2d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fef4b expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868818.473515:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868818.473534:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+9:2403:x1874715918585984:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 59us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.473540:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1787868818.473554:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1787868818.473560:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+8:2403:x1874715918585856:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868818.473568:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868818.473577:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2d11f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963feebf expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868818.473597:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868818.473614:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fecd04dc-e32d-4648-8add-7b218bbcda4e+7:2403:x1874715918585856:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 55us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.473620:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1787868818.489729:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868818.490276:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918586240 00000100:00100000:2.0:1787868818.490296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918586240 00000100:00100000:2.0:1787868818.490377:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:2.0:1787868818.490396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+6:2402:x1874715918586240:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:2.0:1787868818.490434:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d12d 00000020:00010000:2.0:1787868818.490441:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab7f74800: total 0 00000100:00080000:2.0:1787868818.490446:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93dab7f75000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868818.490478:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1787868818.490631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2402:x1874715918586240:12345-192.168.204.27@tcp:39:umount.0 Request processed in 237us (912us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787868818.490638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 260 00000020:00010000:0.0:1787868818.491076:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab7f74800: total 0 00010000:00010000:0.0:1787868818.491082:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868818.491134:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab7f74800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787868818.491207:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9870c6300) 00010000:00010000:0.0:1787868818.491211:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868818.491219:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2e0ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff326 expref: 4 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868818.491260:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab7f74800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787868818.491274:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868818.491277:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868818.491279:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868818.491558:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868818.508864:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868818.508980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918586368 00000100:00100000:1.0:1787868818.508990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918586368 00000100:00100000:1.0:1787868818.509071:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 261 00000100:00100000:1.0:1787868818.509082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+5:2402:x1874715918586368:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1787868818.509122:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2d134 00000100:00080000:1.0:1787868818.509145:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93dab7f75800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868818.509203:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787868818.509372:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:40f2da0d-44ae-4ff7-a83f-de7677877c0e+3:2402:x1874715918586368:12345-192.168.204.27@tcp:39:umount.0 Request processed in 290us (517us total) trans 4294967300 rc 0/0 00000100:00080000:0.0:1787868818.509480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868818.509727:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 261 00010000:00010000:3.0:1787868818.510867:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868818.534675:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868818.590902:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868818.591046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918586624 00000100:00100000:1.0:1787868818.591056:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918586624 00000100:00100000:1.0:1787868818.591117:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 405 00000100:00100000:1.0:1787868818.591128:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+7:2402:x1874715918586624:12345-192.168.204.27@tcp:251:umount.0 00000020:00000080:1.0:1787868818.591222:0:6507:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cff2 00000020:00010000:1.0:1787868818.591229:0:6507:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab6f68000: total 0 00000100:00080000:1.0:1787868818.591246:0:6507:0:(import.c:65:import_set_state_nolock()) ffff93dab6f6d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787868818.591332:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daae631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fecd04dc-e32d-4648-8add-7b218bbcda4e+3:2402:x1874715918586624:12345-192.168.204.27@tcp:251:umount.0 Request processed in 205us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868818.591340:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 405 00000020:00010000:0.0:1787868818.591515:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab6f68000: total 0 00010000:00010000:0.0:1787868818.591564:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab6f68000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787868818.591598:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2d0cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963fee80 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868818.591611:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab6f68000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787868818.591618:0:6500:0:(genops.c:885:class_export_put()) final put ffff93dab6f68000/fecd04dc-e32d-4648-8add-7b218bbcda4e 00010000:00010000:0.0:1787868818.591638:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868818.591641:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868818.591643:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787868818.592860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f68000/fecd04dc-e32d-4648-8add-7b218bbcda4e for MGS 00000020:00000080:1.0:1787868818.592918:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6f6d000 for MGS 00000001:00100000:2.0:1787868818.724045:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:2.0:1787868818.724056:0:8423:0:(genops.c:885:class_export_put()) final put ffff93daa072f000/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:1.0:1787868818.724193:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa072f000/666039a7-1461-4e99-8c4e-10237114565a for lustre-OST0000 00000020:00000080:1.0:1787868818.724244:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daa072e000 for lustre-OST0000 00010000:00010000:3.0:1787868819.553340:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868820.578301:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787868820.680942:0:15100:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787868820.720523:0:15100:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787868820.720584:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.720599:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.720606:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.720613:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.720634:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787868820.720640:0:15100:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787868820.720818:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868820.720823:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787868820.720829:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787868820.720853:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93daaf700800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787868820.721881:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868820.721892:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.721903:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868820.721907:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.721916:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868820.721923:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868820.721950:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868820.721953:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787868820.721956:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787868820.721987:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.721994:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868820.722024:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.722031:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2d09a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.722044:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868820.722045:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868820.722047:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868820.722177:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868820.722840:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939609856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.722912:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.723864:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939609728:0@lo:39:umount.0 00000100:00100000:0.0:1787868820.723910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.723955:0:10190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609728 00000100:00100000:0.0:1787868820.723962:0:10190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609728 00000100:00100000:0.0:1787868820.724015:0:10190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787868820.724025:0:10190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874715939609728:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787868820.724051:0:10190:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc09 00000100:00080000:0.0:1787868820.724060:0:10190:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc6800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787868820.724120:0:10190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3635:x1874715939609728:12345-0@lo:39:umount.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868820.724139:0:10190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787868820.724149:0:10190:0:(genops.c:885:class_export_put()) final put ffff93dab5bc4800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787868820.724336:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787868820.724346:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5bc4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787868820.724391:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5bc6800 for lustre-MDT0000 00000100:00100000:1.0:1787868820.724717:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609856 00000100:00100000:1.0:1787868820.724722:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609856 00000100:00100000:1.0:1787868820.724771:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787868820.724779:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+24:3636:x1874715939609856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868820.724790:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868820.724806:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2d0a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d09a expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.724832:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868820.724872:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:3636:x1874715939609856:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868820.724878:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787868820.724915:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939609856:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787868820.726579:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daaf700800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787868820.726603:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939609728:0@lo:39:umount.0 00000100:00080000:2.0:1787868820.726886:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868820.726890:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787868820.726895:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787868820.727849:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727866:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727874:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727894:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727917:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868820.727924:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727931:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727937:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727944:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727957:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787868820.727963:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727970:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727976:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.727983:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.728008:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787868820.728015:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.728020:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.728025:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.728031:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868820.728037:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787868820.728040:0:15100:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787868820.728070:0:15100:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787868820.728074:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787868820.728078:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.728083:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787868820.728089:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93dabec6c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787868820.728095:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93dabec6d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787868820.728100:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93dab5b26000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787868820.728104:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93dab6c7f800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787868820.728111:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93dab7f74800 40f2da0d-44ae-4ff7-a83f-de7677877c0e 192.168.204.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787868820.728116:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93dab7ed9000 666039a7-1461-4e99-8c4e-10237114565a 192.168.204.27@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787868820.728121:0:15100:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93daae68ced8) has exports, disconnecting them 00000020:00080000:2.0:1787868820.728133:0:15100:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93dabec6c000), last request at 1787868817 00000020:00000080:2.0:1787868820.728141:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf19 00000100:00080000:2.0:1787868820.728193:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dabec6a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787868820.728276:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dabec6c000): rc 0 00000020:00000080:2.0:1787868820.728279:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dabec6c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787868820.728287:0:15100:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93dabec6d800), last request at 1787868817 00000020:00000080:2.0:1787868820.728291:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cdf3 00000100:00080000:2.0:1787868820.728296:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dabec69000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787868820.728302:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dabec6d800): rc 0 00000020:00000080:2.0:1787868820.728304:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dabec6d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787868820.728308:0:15100:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93dab5b26000), last request at 1787868561 00000020:00000080:2.0:1787868820.728310:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ccf0 00000100:00080000:2.0:1787868820.728314:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dab5bf6800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787868820.728319:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab5b26000): rc 0 00000020:00000080:2.0:1787868820.728320:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab5b26000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787868820.728324:0:15100:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93dab6c7f800), last request at 1787868561 00000020:00000080:2.0:1787868820.728327:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ccb8 00000100:00080000:2.0:1787868820.728330:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dab5b20800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868820.728337:0:15100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787868820.728411:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab6c7f800): rc 0 00000004:00000080:2.0:1787868820.728417:0:15100:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3fe48053ae0 00000100:00080000:2.0:1787868820.728434:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787868820.728437:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787868820.729280:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787868820.729307:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dab6e73000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787868820.729402:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787868820.729410:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729420:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d3800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868820.729424:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729433:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868820.729441:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868820.729446:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787868820.729448:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787868820.729451:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787868820.729478:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729484:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868820.729509:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729536:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d3800/0x2f11f4d3bde2d0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d0af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729548:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787868820.729552:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729556:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868820.729560:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729566:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868820.729571:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868820.729575:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787868820.729577:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787868820.729579:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787868820.729592:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729598:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868820.729604:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729610:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd871a00/0x2f11f4d3bde2cfac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cfb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729629:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787868820.729632:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729637:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868820.729640:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.729647:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868820.729653:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868820.729658:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787868820.729661:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787868820.729662:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787868820.730491:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868820.730498:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730507:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac20ff400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868820.730511:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730519:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868820.730526:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868820.730532:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868820.730534:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787868820.730537:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787868820.730565:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730571:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868820.730590:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730597:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac20ff400/0x2f11f4d3bde2cb68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cb6f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730618:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868820.730620:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868820.730621:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868820.730631:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868820.730652:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939610368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.730725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.730782:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610368 00000100:00100000:0.0:1787868820.730788:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610368 00000100:00100000:0.0:1787868820.730841:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868820.730850:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:3637:x1874715939610368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868820.730864:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868820.730877:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2071400/0x2f11f4d3bde2cb6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cb68 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868820.730890:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868820.730924:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:3637:x1874715939610368:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868820.730930:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868820.730967:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939610368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.730989:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939609984:0@lo:39:umount.0 00000100:00100000:0.0:1787868820.731018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.731721:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939610240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.731755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.731778:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868820.731783:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939610112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.731816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868820.731897:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787868820.731909:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787868820.731964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787868820.731984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5b26000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787868820.732009:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabec6a800 for lustre-MDT0000 00000020:00000080:3.0:1787868820.732015:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabec69000 for lustre-MDT0000 00000020:00000080:3.0:1787868820.732019:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5bf6800 for lustre-MDT0000 00000100:00100000:3.0:1787868820.732621:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610240 00000100:00100000:3.0:1787868820.732628:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610240 00000100:00100000:3.0:1787868820.732668:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610112 00000100:00100000:3.0:1787868820.732671:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610112 00000100:00100000:3.0:1787868820.732691:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868820.732699:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+23:3639:x1874715939610240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868820.732710:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868820.732724:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2cfb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cfac expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868820.732747:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868820.732791:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+22:3639:x1874715939610240:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868820.732797:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868820.732813:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868820.732819:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+21:3639:x1874715939610112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868820.732827:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868820.732836:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2d0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0a8 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868820.732843:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868820.732865:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3639:x1874715939610112:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868820.732870:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787868820.733034:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.733043:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868820.733060:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.733066:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2d310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d317 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.733077:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868820.733078:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868820.733086:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868820.733100:0:7741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939609984 00000100:00100000:1.0:1787868820.733104:0:7741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939609984 00000100:00100000:1.0:1787868820.733135:0:7741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787868820.733141:0:7741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939609984:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787868820.733177:0:7741:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cd4b 00000100:00080000:1.0:1787868820.733195:0:7741:0:(import.c:65:import_set_state_nolock()) ffff93daae796800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868820.733214:0:7741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787868820.733375:0:7741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3635:x1874715939609984:12345-0@lo:39:umount.0 Request processed in 233us (2355us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787868820.733382:0:7741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787868820.733556:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939610496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787868820.733588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868820.733644:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6e73000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787868820.733652:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939609984:0@lo:39:umount.0 00010000:00010000:1.0:1787868820.733664:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868820.734108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610496 00000100:00100000:3.0:1787868820.734114:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610496 00000100:00100000:3.0:1787868820.734149:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868820.734269:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+20:3637:x1874715939610496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868820.734281:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868820.734296:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286800/0x2f11f4d3bde2d317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d310 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868820.734308:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868820.734351:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f+19:3637:x1874715939610496:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868820.734357:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868820.734412:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939610112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868820.734421:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3639:1874715939610240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868820.735343:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939610496:0@lo:103:ldlm_bl.0 00000001:00100000:3.0:1787868820.736571:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868820.736579:0:6491:0:(genops.c:885:class_export_put()) final put ffff93dab6c7f800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787868820.736600:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00080000:3.0:1787868820.736612:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1787868820.736615:0:6491:0:(genops.c:885:class_export_put()) final put ffff93dab7f74800/40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00100000:3.0:1787868820.736620:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000001:00080000:3.0:1787868820.736624:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787868820.736634:0:6491:0:(genops.c:885:class_export_put()) final put ffff93dab7ed9000/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:0.0:1787868820.736694:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6c7f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787868820.736748:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7f74800/40f2da0d-44ae-4ff7-a83f-de7677877c0e for lustre-MDT0000 00000020:00000080:0.0:1787868820.736773:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ed9000/666039a7-1461-4e99-8c4e-10237114565a for lustre-MDT0000 00000020:00000080:0.0:1787868820.736801:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5b20800 for lustre-MDT0000 00000020:00000080:0.0:1787868820.736806:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7f75000 for lustre-MDT0000 00000020:00000080:0.0:1787868820.736810:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7ede800 for lustre-MDT0000 00000100:00080000:2.0:1787868820.747880:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868820.747889:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787868820.747914:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787868820.747990:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787868820.748019:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dabd86e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787868820.748039:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868820.748041:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787868820.748051:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787868820.748121:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787868820.748130:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93dabec45800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787868820.748224:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939610624:0@lo:9:umount.0 00000100:00100000:0.0:1787868820.748314:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868820.748361:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939610752:0@lo:9:umount.0 00000100:00100000:0.0:1787868820.748382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868820.748536:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610624 00000100:00100000:3.0:1787868820.748554:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610624 00000100:00100000:3.0:1787868820.748612:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610752 00000100:00100000:3.0:1787868820.748616:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610752 00000100:00100000:3.0:1787868820.748646:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787868820.748651:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868820.748657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868820.748659:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939610624:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787868820.748685:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce9b 00000100:00080000:3.0:1787868820.748694:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93dab6dba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787868820.748746:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787868820.748890:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3635:x1874715939610624:12345-0@lo:9:umount.0 Request processed in 234us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868820.748898:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868820.748916:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868820.748923:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939610752:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787868820.748936:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cfeb 00000100:00080000:3.0:1787868820.748941:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93dabec6b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787868820.748963:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1787868820.749038:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868820.749045:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3635:x1874715939610752:12345-0@lo:9:umount.0 Request processed in 122us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868820.749054:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787868820.749077:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabd86e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787868820.749094:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787868820.749096:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868820.749100:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939610624:0@lo:9:umount.0 00000100:00080000:0.0:1787868820.749113:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec45800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787868820.749123:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787868820.749125:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868820.749128:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939610752:0@lo:9:umount.0 00010000:00010000:1.0:1787868820.749595:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787868820.749769:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787868820.749780:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1787868820.749783:0:7444:0:(genops.c:885:class_export_put()) final put ffff93dab6dbb800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1787868820.749788:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93daae68ced8) has no exports 00000001:00100000:0.0:1787868820.749803:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00080000:0.0:1787868820.749818:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1787868820.749821:0:7444:0:(genops.c:885:class_export_put()) final put ffff93dab7f70000/40f2da0d-44ae-4ff7-a83f-de7677877c0e 00000001:00100000:0.0:1787868820.749828:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000001:00080000:0.0:1787868820.749832:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1787868820.749834:0:7444:0:(genops.c:885:class_export_put()) final put ffff93dab7edd800/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:3.0:1787868820.749853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6dbb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787868820.749903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7f70000/40f2da0d-44ae-4ff7-a83f-de7677877c0e for lustre-MDT0001 00000020:00000080:3.0:1787868820.749927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7edd800/666039a7-1461-4e99-8c4e-10237114565a for lustre-MDT0001 00000020:00000080:3.0:1787868820.749949:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daae796800 for lustre-MDT0001 00000020:00000080:3.0:1787868820.749954:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7f75800 for lustre-MDT0001 00000020:00000080:3.0:1787868820.749958:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7edc000 for lustre-MDT0001 00000001:00100000:2.0:1787868820.752649:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787868820.752658:0:9508:0:(genops.c:885:class_export_put()) final put ffff93dabec6d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787868820.752689:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:2.0:1787868820.752692:0:9508:0:(genops.c:885:class_export_put()) final put ffff93daa072c000/666039a7-1461-4e99-8c4e-10237114565a 00000020:00000080:0.0:1787868820.752747:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787868820.752798:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa072c000/666039a7-1461-4e99-8c4e-10237114565a for lustre-OST0001 00000020:00000080:0.0:1787868820.752819:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabec6b000 for lustre-OST0001 00000020:00000080:0.0:1787868820.752824:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daa072f800 for lustre-OST0001 00000020:00080000:3.0:1787868820.759753:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93daae68ced8) has no exports 00000020:00000080:3.0:1787868820.853225:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cbc3 00000020:00000080:3.0:1787868820.853253:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88342000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787868820.853280:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787868820.853324:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88342000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787868820.853766:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.853788:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787868820.853793:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93dab59f4ed8) has no exports 00000020:00000080:2.0:1787868820.854276:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cbbc 00000020:00000080:2.0:1787868820.854283:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab59e9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787868820.854337:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868820.854345:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787868820.854348:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab59e9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787868820.854349:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab59ea800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787868820.854353:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab59ea800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787868820.854367:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1787868820.854617:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da84f80840 - data ffff93daafab2288/ffff93d98739a800 00000020:01000000:0.0:1787868820.854778:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da82e39a20 - data ffff93daaf95a510/ffff93dab59f8400 00000001:00000004:2.0:1787868820.871478:0:15100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1787868820.937594:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787868820.937602:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787868820.937616:0:15100:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93d986f94000 x1874715939609984/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787868830 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868820.937640:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787868820.940102:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868820.940119:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1787868820.940285:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868820.940288:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787868820.940697:0:8958:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787868820.940702:0:8958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787868820.940713:0:8958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787868820.941698:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868820.941702:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1787868820.941750:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868820.941753:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787868820.942102:0:9887:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787868820.942106:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787868820.942115:0:9887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787868820.943817:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cb8b 00000020:00000080:2.0:1787868820.943826:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88305000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787868820.946601:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cba0 00000020:00000080:2.0:1787868820.946612:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88346800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.946659:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88305000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787868820.946718:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787868820.946723:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.946731:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787868820.946735:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93daae689a48) has no exports 00000004:01000000:2.0:1787868820.946990:0:15100:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787868820.946999:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cfd6 00000020:00000080:2.0:1787868820.947004:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dabec69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.947030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88346800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787868820.947127:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787868820.947131:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.947139:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868820.947142:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff93d9863d0000) has no exports 00000020:00000080:2.0:1787868820.947147:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cfcf 00000020:00000080:2.0:1787868820.947151:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dabec44000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787868820.949298:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec69800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1787868820.949998:0:15100:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787868820.950007:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868820.950011:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1787868820.950017:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868820.950019:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787868820.950050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec44000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787868820.950128:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868820.950140:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787868820.950147:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce94 00000020:00000080:2.0:1787868820.950175:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab7ec8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.950313:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabec45800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787868820.950319:0:8:0:(genops.c:885:class_export_put()) final put ffff93d986313000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.950321:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986313000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787868820.950326:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787868820.950621:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787868820.950626:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.950632:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868820.950636:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff93dab59f0000) has no exports 00000020:00000080:2.0:1787868820.950642:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce8d 00000020:00000080:2.0:1787868820.950645:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dabd86f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787868820.950758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ec8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787868820.951020:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabd86f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787868820.951634:0:15100:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787868820.951638:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868820.951641:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1787868820.951646:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868820.951647:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787868820.951734:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868820.951742:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787868820.951757:0:15100:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787868820.951763:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cd44 00000020:00000080:2.0:1787868820.951768:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab6e09800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.951788:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabd86e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787868820.951795:0:8:0:(genops.c:885:class_export_put()) final put ffff93dabec6c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.951805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787868820.951810:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787868820.952002:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787868820.952006:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868820.952010:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868820.952013:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93dab59f3490) has no exports 00000020:00000080:2.0:1787868820.952018:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cd3d 00000020:00000080:2.0:1787868820.952021:0:15100:0:(genops.c:885:class_export_put()) final put ffff93dab6e77800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787868820.952067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e09800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:1.0:1787868820.953234:0:15100:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787868820.953249:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787868820.953252:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787868820.953258:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787868820.953555:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868820.953616:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868820.953625:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868820.953648:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868820.953651:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868820.953663:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88302000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868820.953666:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88302000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787868820.953673:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868820.953761:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cba7 00000020:00000080:1.0:1787868820.953766:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88347000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787868820.953771:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787868820.953775:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868820.953779:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787868820.953782:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93daaf710000) has no exports 00000020:00000080:1.0:1787868820.953802:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868820.953805:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787868820.953809:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cbae 00000020:00000080:1.0:1787868820.953812:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88341000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787868820.953820:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daa05d8800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787868820.953823:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05d8800 3 00000020:01000004:1.0:1787868820.953827:0:15100:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93daa05d8800 from lustre-MDT0000 00000020:00000080:1.0:1787868820.953843:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868820.953847:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787868820.953850:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da88300000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787868820.953852:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88300000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787868820.953858:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787868820.953997:0:15100:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787868820.954001:0:15100:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787868820.954003:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787868820.954018:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868820.954021:0:15100:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787868820.954030:0:15100:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93daa0518800 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787868820.954035:0:15100:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93dabc0bced8) has exports, disconnecting them 00000020:00080000:1.0:1787868820.954039:0:15100:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93daa0518800), last request at 1787868540 00000020:00000080:1.0:1787868820.954055:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cb4c 00000020:00010000:1.0:1787868820.954059:0:15100:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93daa0518800: total 2 00000100:00080000:1.0:1787868820.954068:0:15100:0:(import.c:65:import_set_state_nolock()) ffff93da8362b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787868820.954080:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daa0518800): rc 0 00000020:00080000:1.0:1787868820.954084:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93dabc0bced8) has no exports 00000020:00010000:1.0:1787868820.954093:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93daa0518800: total 2 00010000:00010000:1.0:1787868820.954115:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93daa0518800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787868820.954145:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffc00/0x2f11f4d3bde2d04d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d046 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954253:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2d05b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d054 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954266:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870e00/0x2f11f4d3bde2d309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d302 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954276:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2cf6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cf66 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954286:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2d077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d070 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954294:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2d069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d062 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954304:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da813d2400/0x2f11f4d3bde2cc48 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc41 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954314:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20ffe00/0x2f11f4d3bde2d085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d07e expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954322:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871600/0x2f11f4d3bde2d093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d08c expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954489:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac20fe400/0x2f11f4d3bde2d0bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d0b6 expref: 5 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954501:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b200/0x2f11f4d3bde2d2fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2f4 expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954510:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2cc56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2cc4f expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954520:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2d2ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2d2e6 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868820.954528:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93daa0518800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787868820.954540:0:6500:0:(genops.c:885:class_export_put()) final put ffff93daa0518800/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f 00010000:00010000:1.0:1787868820.954545:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868820.954547:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868820.954548:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868820.954596:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93da8ffc3e00:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1787868820.954649:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93da8ffc3400:6506] 1 exiting: rc = 0 00000020:00000080:3.0:1787868820.954713:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6e73000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787868820.954719:0:8:0:(genops.c:885:class_export_put()) final put ffff93dab6e75000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868820.954721:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e75000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787868820.954725:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787868820.954771:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88347000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787868820.954775:0:8:0:(genops.c:885:class_export_put()) final put ffff93da882bb800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787868820.954777:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da882bb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787868820.954780:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787868820.954804:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88341000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787868820.954808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa0518800/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f for MGS 00000020:00000080:3.0:1787868820.954830:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da8362b800 for MGS 00000100:00100000:1.0:1787868820.955040:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93da99da6600:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1787868820.955091:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955098:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955104:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955109:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955114:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955119:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955125:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955130:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955134:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955139:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955144:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955278:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955283:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955289:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955294:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955299:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955305:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955310:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955316:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955321:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955327:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955568:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955577:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955582:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955587:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955593:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955597:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955602:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955607:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955612:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955616:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955621:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955626:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955630:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955635:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955640:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955645:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955649:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955655:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955659:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955664:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955670:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955674:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955680:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955693:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955698:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955708:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955713:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955718:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955723:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955728:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955733:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955738:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955743:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955748:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955753:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955758:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955763:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955768:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955773:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955778:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955784:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955790:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868820.955795:0:15100:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787868820.957058:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d98224b0c0 - data ffff93daafb39a20/ffff93dabeffe000 00000020:01000000:1.0:1787868820.957288:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da82e390c0 - data ffff93daa0a8b360/ffff93daae5d9000 00000020:00000080:1.0:1787868820.957830:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cb30 00000020:00000080:1.0:1787868820.957838:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da82b4c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787868820.957854:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daa05d8800 from MGS, refs=2 00000020:01000004:1.0:1787868820.957857:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05d8800 2 00000020:01000004:1.0:1787868820.957860:0:15100:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93daa05d8800 from MGS 00000020:00000080:1.0:1787868820.957994:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868820.958002:0:15100:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787868820.958005:0:15100:0:(genops.c:885:class_export_put()) final put ffff93da82b49800/MGS 00000020:00000080:1.0:1787868820.958008:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93da82b49800/MGS for MGS 00000020:01000000:1.0:1787868820.958014:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787868820.958077:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787868820.958081:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868820.958086:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787868820.958093:0:15100:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93daaf706000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787868820.958108:0:15100:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93dabc0bb490) has exports, disconnecting them 00000020:00080000:1.0:1787868820.958112:0:15100:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93daaf706000), last request at 1787868540 00000020:00000080:1.0:1787868820.958116:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cbfb 00000020:00080000:1.0:1787868820.958127:0:15100:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daaf706000): rc 0 00000020:00000080:1.0:1787868820.958131:0:15100:0:(genops.c:885:class_export_put()) final put ffff93daaf706000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787868820.958291:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93da82b4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787868820.958298:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daaf706000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787868820.960222:0:15100:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787868820.960229:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868820.960233:0:15100:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787868820.960249:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787868820.960275:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daaf700800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787868820.960451:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868820.960460:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787868820.960464:0:15100:0:(genops.c:885:class_export_put()) final put ffff93daaf701800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787868820.960467:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93daaf701800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787868820.960484:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787868820.960554:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05d8800 1 00000020:00000080:3.0:1787868820.960560:0:15100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cb22 00000020:00000080:3.0:1787868820.960566:0:15100:0:(genops.c:885:class_export_put()) final put ffff93daa02dd800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787868820.960574:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787868820.960580:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa02dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787868820.960589:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868820.960594:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787868820.960597:0:15100:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93daae68b490) has no exports 00000020:00000080:2.0:1787868821.215529:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868821.215543:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787868821.215548:0:15100:0:(genops.c:885:class_export_put()) final put ffff93daa02da000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787868821.215553:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa02da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787868821.215565:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787868821.215696:0:15100:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93daa05df800 00000020:02000400:2.0:1787868821.215762:0:15100:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787868821.605882:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868822.629674:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868822.818317:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868822.818344:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939610880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868822.818412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868822.818540:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939610880 00000100:00100000:0.0:1787868822.818548:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939610880 00000100:00100000:0.0:1787868822.818611:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787868822.818621:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939610880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868822.818650:0:13387:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787868822.818692:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939610880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868822.818699:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787868822.818719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868822.818904:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939611008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868822.818934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868822.818998:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939610880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868822.819746:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939611136:0@lo:400:kworker.0 00000400:00000100:2.0:1787868822.819773:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939611136 offset 0 length 224: 4 00000100:00100000:2.0:1787868822.819819:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939611648:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.819845:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.819868:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787868822.819874:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939611264:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.819896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.819912:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939611776:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.819933:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.819975:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611648 00000100:00100000:2.0:1787868822.820144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611648 00000100:00100000:2.0:1787868822.820190:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611264 00000100:00100000:2.0:1787868822.820194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611264 00000100:00100000:2.0:1787868822.820219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611776 00000100:00100000:2.0:1787868822.820222:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611776 00000100:00100000:2.0:1787868822.820247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787868822.820255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939611776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.820300:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939611776:12345-0@lo:400:kworker.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868822.820306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787868822.820323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787868822.820327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874715939611648:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787868822.820332:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787868822.820356:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874715939611648:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868822.820362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787868822.820373:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787868822.820377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874715939611264:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787868822.820381:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787868822.820411:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874715939611264:12345-0@lo:400:kworker.0 Request processed in 32us (513us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868822.820417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787868822.820448:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939611392:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.820472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.820490:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939611904:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.820512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.821663:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868822.821674:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939611520:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.821709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868822.821740:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611904 00000100:00100000:2.0:1787868822.821746:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611904 00000100:00100000:2.0:1787868822.823078:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787868822.823101:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939611904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.823188:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939611904:12345-0@lo:400:kworker.0 Request processed in 95us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868822.823194:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787868822.823241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611392 00000100:00100000:2.0:1787868822.823245:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611392 00000100:00100000:2.0:1787868822.823267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611520 00000100:00100000:2.0:1787868822.823270:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611520 00000100:00100000:2.0:1787868822.823291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1787868822.823296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939611520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.823327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939611520:12345-0@lo:400:kworker.0 Request processed in 31us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868822.823333:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1787868822.823345:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787868822.823359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874715939611392:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787868822.823366:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787868822.823392:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874715939611392:12345-0@lo:400:kworker.0 Request processed in 31us (2919us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868822.823410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787868822.823434:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868822.823438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787868822.823467:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d986f96940 x1874715939611520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868822.823481:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939611520:0@lo:400:kworker.0 00000100:00080000:2.0:1787868822.823493:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787868822.823498:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787868822.823502:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787868822.824675:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939611008 00000100:00100000:0.0:1787868822.824682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939611008 00000100:00100000:0.0:1787868822.824714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787868822.824721:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874715939611008:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787868822.824727:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787868822.824771:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874715939611008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (5836us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787868822.824778:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1787868822.837697:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787868822.837707:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93da882be000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787868822.837712:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787868822.837717:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93da882be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868822.837721:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787868822.837730:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93da882be000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868822.837762:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9881903c0 x1874715939612032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868822.837801:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939611264:0@lo:400:kworker.0 00010000:00080000:3.0:1787868822.837821:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d986f94000 x1874715939611776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868822.837832:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939611776:0@lo:400:kworker.0 00000100:00080000:3.0:1787868822.837845:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787868822.837848:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787868822.837851:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787868822.837864:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868822.837868:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 229 00000100:00080000:3.0:1787868822.837872:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93dabec6f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868822.837886:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9881921c0 x1874715939612160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868822.837897:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939611648:0@lo:400:kworker.0 00000100:02020000:3.0:1787868822.837946:0:3639:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1787868822.838357:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939612032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787868822.838419:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868822.838457:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939612160:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787868822.838477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868822.854737:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868822.854748:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 207 00000100:00080000:2.0:1787868822.854758:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d986e3e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868822.854794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612032 00000100:00100000:2.0:1787868822.854804:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612032 00000100:00100000:2.0:1787868822.854846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612160 00000100:00100000:2.0:1787868822.854849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612160 00000100:00100000:2.0:1787868822.854866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787868822.854874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939612032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787868822.854896:0:6514:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787868822.854993:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939612032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 118us (16573us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787868822.855001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787868822.855034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787868822.855039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939612160:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787868822.855049:0:6514:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787868822.855076:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939612160:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 36us (16598us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787868822.855082:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787868822.870759:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988242580 x1874715939612288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868822.870800:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939611392:0@lo:400:kworker.0 00000100:00100000:0.0:1787868822.870843:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939611904:0@lo:400:kworker.0 00000100:00100000:2.0:1787868822.879471:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939612288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787868822.879547:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868822.879614:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da882be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868822.879619:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787868822.879624:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939612032:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787868822.879637:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868822.879640:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787868822.879644:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939612160:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787868822.879675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612288 00000100:00100000:2.0:1787868822.879681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612288 00000100:00100000:2.0:1787868822.879714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787868822.879722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939612288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787868822.879744:0:6512:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787868822.879803:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939612288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 80us (255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787868822.879811:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787868822.879839:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868822.879844:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787868822.879847:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939612288:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787868822.888432:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787868822.888440:0:3639:0:(import.c:65:import_set_state_nolock()) ffff93dabda6d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787868822.888445:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787868822.888451:0:3639:0:(import.c:65:import_set_state_nolock()) ffff93dabda6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868822.888456:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787868822.888465:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93dabda6d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868822.891121:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a80780 x1874715939612416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868822.891221:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939612416:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787868822.891310:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868822.891819:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612416 00000100:00100000:1.0:1787868822.891827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612416 00000100:00100000:1.0:1787868822.891873:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787868822.891882:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939612416:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1787868822.891905:0:6518:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868822.891957:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939612416:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 75us (647us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868822.891965:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:1.0:1787868822.892014:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabda6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868822.892019:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868822.892023:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939612416:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787868823.331144:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868823.338838:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939612544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868823.338928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868823.339107:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612544 00000100:00100000:3.0:1787868823.339120:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612544 00000100:00100000:3.0:1787868823.339185:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787868823.339207:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939612544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868823.339241:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787868823.340092:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939612544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 896us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868823.340103:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787868823.347319:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939612544:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787868823.655342:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868824.677611:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787868825.696946:0:15301:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:0.0:1787868825.700753:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787868825.713390:0:15301:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787868825.713562:0:15301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713579:0:15301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713587:0:15301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713595:0:15301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713613:0:15301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787868825.713619:0:15301:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787868825.713647:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868825.713654:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713662:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868825.713666:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713675:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868825.713683:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868825.713689:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787868825.713705:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787868825.713708:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787868825.713747:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713754:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868825.713787:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713795:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2600/0x2f11f4d3bde2d07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d085 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.713809:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868825.713811:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868825.713812:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868825.713827:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787868825.713832:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787868825.713839:0:15301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787868825.713844:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93da882be000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787868825.713849:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787868825.713851:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787868825.713854:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787868825.714675:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868825.714697:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939612672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868825.714768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868825.715167:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939612672 00000100:00100000:3.0:1787868825.715175:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939612672 00000100:00100000:3.0:1787868825.715219:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787868825.715228:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1874715939612672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787868825.715258:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868825 with bad export cookie 3391761184647727948 00010000:00010000:1.0:1787868825.716253:0:15301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716268:0:15301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716276:0:15301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716296:0:15301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716314:0:15301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787868825.716325:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868825.716331:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716338:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da813d2c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868825.716342:0:7921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.716351:0:7921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868825.716359:0:7921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868825.716365:0:7921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787868825.716367:0:7921:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787868825.716398:0:7921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717585:0:15301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717600:0:15301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717607:0:15301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717614:0:15301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717647:0:15301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868825.717658:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868825.717663:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717670:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868825.717674:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717682:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868825.717689:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868825.717696:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868825.717698:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787868825.717701:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787868825.717727:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717733:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868825.717764:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717772:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2070000/0x2f11f4d3bde2cf66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cf6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717790:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868825.717797:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868825.717800:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868825.717810:0:15301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717818:0:15301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717825:0:15301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717831:0:15301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717843:0:15301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868825.717848:0:15301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717855:0:15301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717862:0:15301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717869:0:15301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717882:0:15301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787868825.717885:0:15301:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787868825.717889:0:15301:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787868825.717923:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868825.717932:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717938:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868825.717941:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717947:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868825.717953:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868825.717958:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787868825.717960:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787868825.717962:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787868825.717976:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.717981:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868825.717995:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718001:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ac00/0x2f11f4d3bde2d302 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718009:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868825.718012:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718017:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868825.718026:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718033:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868825.718039:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868825.718043:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868825.718046:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787868825.718047:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787868825.718060:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718066:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868825.718072:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718078:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2cc4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2cc56 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868825.718090:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868825.718092:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868825.718093:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868825.718123:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939613056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868825.718217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868825.718276:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868825.718283:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939613184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868825.718305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787868825.718342:0:15301:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787868825.718346:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787868825.718351:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868825.718357:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787868825.718363:0:15301:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93dab7ec9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868825.718368:0:15301:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93d986e38800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868825.718373:0:15301:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff93dabda59a48) has exports, disconnecting them 00000020:00080000:0.0:1787868825.718377:0:15301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93dab7ec9800), last request at 1787868822 00000020:00000080:0.0:1787868825.718384:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf2e 00000100:00080000:0.0:1787868825.718399:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecd000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787868825.718508:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787868825.718521:0:15301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab7ec9800): rc 0 00000020:00000080:0.0:1787868825.718524:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab7ec9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787868825.718535:0:15301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d986e38800), last request at 1787868822 00000020:00000080:0.0:1787868825.718539:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce08 00000100:00080000:0.0:1787868825.718544:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93d986e3d000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787868825.718557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ec9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787868825.718597:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7ecd000 for lustre-MDT0001 00010000:00010000:0.0:1787868825.718605:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787868825.718613:0:15301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986e38800): rc 0 00000020:00000080:0.0:1787868825.718615:0:15301:0:(genops.c:885:class_export_put()) final put ffff93d986e38800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787868825.718625:0:15301:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3fe41c3fae0 00000020:00000080:0.0:1787868825.718636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986e38800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787868825.718655:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986e3d000 for lustre-MDT0001 00000100:00080000:0.0:1787868825.718675:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787868825.718684:0:15301:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93d988243480 x1874715939611008/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787868838 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868825.718694:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1787868825.719546:0:15301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787868825.719552:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93dabda6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1787868825.723967:0:7921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868825.723993:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.724002:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da813d2c00/0x2f11f4d3bde2d08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2d093 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868825.724051:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868825.724054:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868825.724057:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868825.724074:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868825.724095:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939613056 00000100:00100000:1.0:1787868825.724118:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939613056 00000100:00100000:1.0:1787868825.724177:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939613184 00000100:00100000:1.0:1787868825.724181:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939613184 00000100:00100000:1.0:1787868825.724198:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868825.724207:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daaf7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874715939613056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787868825.724215:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868825 with bad export cookie 3391761184647727948 00000100:00100000:1.0:1787868825.724309:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daaf7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874715939613056:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (6092us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787868825.724318:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868825.724333:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868825.724338:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874715939613184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787868825.724341:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868825 with bad export cookie 3391761184647727948 00000100:00100000:1.0:1787868825.724365:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874715939613184:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (6060us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787868825.724370:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787868825.724418:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787868825.724423:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93daae791000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787868825.724427:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787868825.728112:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939611008:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787868825.740003:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787868825.740009:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1787868825.740026:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787868825.740116:0:15301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787868825.740141:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93dab6dbd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787868825.740186:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787868825.740189:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787868825.740198:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787868825.740522:0:15301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787868825.740536:0:15301:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787868825.740566:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93dabda59a48) has no exports 00000100:00100000:0.0:1787868825.741473:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1874715939612672:12345-0@lo:103:ldlm_bl.0 Request processed in 26242us (26700us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787868825.741485:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787868825.774864:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.127@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787868825.774871:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787868825.774883:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d986f95a40 x1874715939611136/t0(0) o400->MGC192.168.204.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787868838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868825.774920:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393ed00 x1874715939612672/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787868841 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868825.774930:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d988241e00 x1874715939613056/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787868841 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868825.774940:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d988242580 x1874715939613184/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787868841 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868825.781188:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:0:1874715939612928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868825.781219:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3637:1874715939612672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868825.781489:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:0:1874715939612800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868825.781503:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3636:1874715939611136:0@lo:400:kworker.0 10000000:01000000:1.0:1787868825.785219:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787868825.785227:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787868825.785229:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787868825.785234:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93daae791000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787868825.785250:0:3638:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1787868825.785260:0:3638:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93daae791000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868825.785281:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939613312:0@lo:9:umount.0 00000100:00100000:1.0:1787868825.785352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868825.785415:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939613440:0@lo:9:umount.0 00000100:00100000:1.0:1787868825.785436:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868825.785483:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939613312 00000100:00100000:1.0:1787868825.785490:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939613312 00000100:00100000:1.0:1787868825.785536:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939613440 00000100:00100000:1.0:1787868825.785539:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939613440 00000100:00100000:1.0:1787868825.785564:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787868825.785573:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874715939613312:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787868825.785612:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce55 00000100:00080000:1.0:1787868825.785619:0:8430:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868825.785656:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787868825.786481:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3635:x1874715939613312:12345-0@lo:9:umount.0 Request processed in 904us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868825.786497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868825.786512:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868825.786515:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874715939613440:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787868825.786537:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf97 00000100:00080000:1.0:1787868825.786539:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868825.786546:0:8431:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecb000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787868825.786547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1787868825.786589:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1787868825.786959:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868825.787237:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3635:x1874715939613440:12345-0@lo:9:umount.0 Request processed in 730us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868825.787245:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1787868825.787263:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868825.788218:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6dbd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787868825.788236:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787868825.788238:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868825.788312:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939613312:0@lo:9:umount.0 00000100:00080000:1.0:1787868825.788329:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787868825.788339:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787868825.788341:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868825.788343:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939613440:0@lo:9:umount.0 00000100:00100000:1.0:1787868825.790190:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393ed00 x1874715939613568/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868825.790234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939613056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787868825.790259:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3638:1874715939613184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868825.790961:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939613568:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1787868825.791011:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939613568 offset 0 length 520: 4 00000001:00100000:1.0:1787868825.792774:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787868825.792782:0:8423:0:(genops.c:885:class_export_put()) final put ffff93d986fa5000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787868825.792806:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868825.792809:0:8423:0:(genops.c:885:class_export_put()) final put ffff93dab6dbc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787868825.792850:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787868825.792901:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6dbc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787868825.792919:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986fa0000 for lustre-OST0000 00000020:00000080:0.0:1787868825.792924:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6dba800 for lustre-OST0000 00000020:00080000:3.0:1787868825.799504:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93dabda59a48) has no exports 00000020:01000000:0.0:1787868825.859885:0:15301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da84f801e0 - data ffff93d986443ca8/ffff93d987ef8000 00000020:01000000:0.0:1787868825.860053:0:15301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da8f984420 - data ffff93daaf9eb360/ffff93dabeb0d000 00000001:00000004:2.0:1787868825.874426:0:15301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787868825.921077:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868825.921086:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787868825.921095:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787868825.922497:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868825.922502:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787868825.922521:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868825.922524:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787868825.922732:0:8952:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787868825.922747:0:8952:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787868825.922767:0:8952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787868825.923290:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868825.923294:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787868825.923309:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868825.923311:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787868825.923536:0:9880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787868825.923540:0:9880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787868825.923549:0:9880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787868825.924265:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc72 00000020:00000080:2.0:1787868825.924274:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda32000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787868825.924488:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda32000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787868825.925842:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc87 00000020:00000080:2.0:1787868825.925852:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda69800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787868825.926377:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787868825.926384:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868825.926399:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787868825.926404:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93dabc0b9a48) has no exports 00000004:01000000:2.0:1787868825.926610:0:15301:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787868825.926618:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf90 00000020:00000080:2.0:1787868825.926623:0:15301:0:(genops.c:885:class_export_put()) final put ffff93d986311800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787868825.926709:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda69800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787868825.926763:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787868825.926767:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868825.926774:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868825.926777:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff93d986e4ced8) has no exports 00000020:00000080:2.0:1787868825.926783:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf89 00000020:00000080:2.0:1787868825.926787:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab6f6a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787868825.926993:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986311800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1787868825.927443:0:15301:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787868825.927448:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868825.927452:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787868825.927458:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868825.927460:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868825.927725:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787868825.928075:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6f68800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787868825.928117:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868825.928126:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787868825.928130:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab6f6d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787868825.928133:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787868825.928183:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787868825.928271:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce4e 00000020:00000080:1.0:1787868825.928284:0:15301:0:(genops.c:885:class_export_put()) final put ffff93d986fa4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787868825.928291:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787868825.928294:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868825.928299:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787868825.928302:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff93dabd848000) has no exports 00000020:00000080:1.0:1787868825.928308:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce47 00000020:00000080:1.0:1787868825.928310:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab6db9000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787868825.928619:0:15301:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787868825.928623:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787868825.928625:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1787868825.928629:0:15301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868825.928631:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787868825.928655:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868825.928659:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787868825.928669:0:15301:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787868825.928673:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ccaa 00000020:00000080:1.0:1787868825.928677:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab5b22800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787868825.928681:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787868825.928684:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868825.928686:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787868825.928689:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93dabda5b490) has no exports 00000020:00000080:1.0:1787868825.928692:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cca3 00000020:00000080:1.0:1787868825.928694:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda6c000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787868825.929561:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787868825.929571:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6db9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787868825.929576:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6dbd000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787868825.929581:0:13937:0:(genops.c:885:class_export_put()) final put ffff93d986317800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787868825.929583:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986317800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787868825.929587:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787868825.929650:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5b22800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787868825.929655:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda6c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787868825.930191:0:15301:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787868825.930195:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787868825.930197:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787868825.930203:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868825.930235:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868825.930241:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868825.930263:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868825.930266:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868825.930270:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda31000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787868825.930272:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda31000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787868825.930278:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868825.930417:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc8e 00000020:00000080:0.0:1787868825.930423:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda6b000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787868825.930427:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787868825.930430:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868825.930435:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787868825.930437:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff93dabda5ced8) has no exports 00000020:00000080:0.0:1787868825.930454:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868825.930458:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787868825.930461:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc95 00000020:00000080:0.0:1787868825.930464:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda6a000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787868825.930470:0:15301:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daaf704800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787868825.930482:0:15301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daaf704800 2 00000020:01000004:0.0:1787868825.930486:0:15301:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93daaf704800 from lustre-MDT0001 00000020:00000080:0.0:1787868825.930501:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868825.930504:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787868825.930507:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dabda31800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787868825.930509:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda31800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787868825.930515:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787868825.930540:0:15301:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787868825.930543:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787868825.930546:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868825.930548:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787868825.930554:0:15301:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93dab5b23000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868825.930559:0:15301:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93daaf711a48) has exports, disconnecting them 00000020:00080000:0.0:1787868825.930563:0:15301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93dab5b23000), last request at 1787868561 00000020:00000080:0.0:1787868825.930566:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cce9 00000020:00080000:0.0:1787868825.930575:0:15301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab5b23000): rc 0 00000020:00000080:0.0:1787868825.930578:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab5b23000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787868825.931332:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabda6d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787868825.931341:0:13937:0:(genops.c:885:class_export_put()) final put ffff93dabda68800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787868825.931344:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda68800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787868825.931350:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787868825.931456:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda6b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787868825.931467:0:13937:0:(genops.c:885:class_export_put()) final put ffff93dabda36000/lustre-MDD0001_UUID 00000020:00000080:2.0:1787868825.931469:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda36000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787868825.931472:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787868825.931634:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda6a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787868825.931640:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5b23000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787868825.952575:0:15301:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787868825.952584:0:15301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868825.952588:0:15301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787868825.952594:0:15301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787868825.952623:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da882be000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787868825.952819:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868825.952828:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787868825.952833:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab5b21000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787868825.952837:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5b21000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787868825.952844:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787868825.952911:0:15301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daaf704800 1 00000020:00000080:2.0:1787868825.952917:0:15301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cc25 00000020:00000080:2.0:1787868825.952924:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab59ed000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787868825.952932:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787868825.952938:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab59ed000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787868825.952945:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868825.952950:0:15301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787868825.952953:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93dabc0b8000) has no exports 00000020:00000080:2.0:1787868826.099060:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868826.099076:0:15301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787868826.099082:0:15301:0:(genops.c:885:class_export_put()) final put ffff93daaf707000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787868826.099086:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93daaf707000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787868826.099098:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787868826.099375:0:15301:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93daaf701000 00000020:01000000:2.0:1787868826.099404:0:15301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787868826.099407:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868826.099411:0:15301:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787868826.099416:0:15301:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93daaf713490) has no exports 00000100:00100000:0.0:1787868826.100019:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93dabc09ae00:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1787868826.100132:0:13805:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93d98827ee00:13805] 4 exiting: rc = 0 00000100:00100000:2.0:1787868826.100564:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93daae548400:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1787868826.100639:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93dabc093c00:6513] 1 exiting: rc = 0 00000100:00100000:1.0:1787868826.101223:0:10190:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93d987ed8600:10190] 3 exiting: rc = 0 00000100:00100000:2.0:1787868826.101725:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101734:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101740:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101746:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101751:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101757:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101763:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101769:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101774:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101779:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101784:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101789:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101794:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101800:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101807:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101813:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101819:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101826:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101831:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101836:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101841:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101846:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101851:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101856:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101861:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101867:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101872:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101877:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101882:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101900:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101906:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101911:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101918:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101923:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101930:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101935:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101940:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101946:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101952:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101958:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101964:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101969:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101975:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101979:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101984:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101989:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.101994:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102000:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102004:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102009:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102013:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102019:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102023:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102027:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102032:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102037:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102044:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102049:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102054:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102058:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102063:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102068:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102074:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.102080:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868826.105360:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93dab0321800:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1787868826.105795:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93dab0320400:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1787868826.105888:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105897:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105904:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105910:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105916:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105922:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105928:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105933:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105939:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105944:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105950:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105957:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105962:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105967:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105972:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105977:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105982:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105987:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105992:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.105997:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106002:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106007:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106012:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106018:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106023:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106028:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106033:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106038:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106043:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106047:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106052:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106057:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106061:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106066:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106072:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106089:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106095:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106100:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106105:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106111:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106115:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106120:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106124:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106128:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106133:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106644:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106656:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106662:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106667:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106672:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106677:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106682:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106687:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106692:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106697:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106702:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106707:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106712:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106716:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106721:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106726:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106730:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106735:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.106740:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868826.107328:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93dab0321e00:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1787868826.107486:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93dab0321c00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1787868826.107607:0:7741:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff93dabda14200:7741] 2 exiting: rc = 0 00000100:00100000:2.0:1787868826.107697:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107714:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107723:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107730:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107737:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107754:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107762:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107768:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107791:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107798:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107805:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107811:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107818:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107824:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107832:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107838:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107844:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107851:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107858:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107864:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107885:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107892:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107898:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107905:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107911:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107917:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107924:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107931:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107938:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107956:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107966:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107972:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107979:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107985:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107992:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.107998:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108006:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108013:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108020:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108026:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108039:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108060:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108066:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108072:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108078:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108084:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108091:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108097:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108104:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108110:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108115:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108122:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108128:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108188:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108198:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108203:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108210:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108218:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108223:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108230:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108334:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108342:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108348:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.108362:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868826.119626:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93dab0320c00:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1787868826.120701:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93dab0320600:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1787868826.121548:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121556:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121561:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121566:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121571:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121576:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121581:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121586:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121592:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121597:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121601:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121619:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121623:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121628:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121632:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121636:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121641:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121645:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121649:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121653:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121657:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121662:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121667:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121671:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121675:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121679:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121684:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121688:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121692:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121697:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121702:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121707:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121712:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121716:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121722:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121728:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121732:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121738:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121743:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121748:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121754:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121759:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121766:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121770:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121775:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121780:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121794:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121799:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121803:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121808:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121813:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121818:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121823:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121828:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121833:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121838:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121842:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121848:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121853:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121858:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121863:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121867:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121872:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.121877:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868826.122429:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93daaffda800:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1787868826.122570:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93dab0320e00:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1787868826.122694:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122700:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122705:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122710:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122716:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122721:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122726:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122731:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122736:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122742:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122747:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122753:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122757:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122762:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122768:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122773:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122777:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122790:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122795:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122800:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122805:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122810:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122815:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122820:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122824:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122828:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122833:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122837:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122842:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122847:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122853:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122858:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122863:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122868:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122872:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122877:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122882:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122887:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122892:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122897:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122902:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122908:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122913:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122918:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122924:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122928:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122933:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122938:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122942:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122947:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122952:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122956:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122969:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122974:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122979:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122983:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122989:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122993:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.122998:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.123003:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.123008:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.123013:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.123018:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.123022:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868826.125868:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93daaffda200:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1787868826.126077:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93daaffda000:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1787868826.126202:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126210:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126216:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126221:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126225:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126231:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126247:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126253:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126258:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126264:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126269:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126274:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126278:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126283:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126288:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126293:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126298:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126302:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126307:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126312:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126317:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126321:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126326:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126345:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126351:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126356:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126362:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126367:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126372:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126377:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126382:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126388:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126392:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126397:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126402:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126406:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126411:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126415:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126421:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126426:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126432:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126437:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126442:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126447:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126452:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126457:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126463:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126468:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126472:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126477:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126481:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126486:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126491:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126496:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126502:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126507:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126512:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126517:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126529:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126534:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126547:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126553:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126558:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.126563:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868826.127656:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93daaffdba00:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1787868826.128413:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93daaffc3000:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1787868826.128663:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93daaffdb000:6527] 2 exiting: rc = 0 00000100:00100000:2.0:1787868826.128840:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128852:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128859:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128864:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128869:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128897:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128905:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128911:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128917:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128923:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128929:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128934:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128940:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128946:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128951:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128957:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128962:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128968:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128974:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128979:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128985:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128990:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.128996:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129001:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129007:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129013:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129018:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129024:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129029:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129057:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129064:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129069:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129075:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129079:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129086:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129091:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129097:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129104:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129109:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129114:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129120:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129126:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129132:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129149:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129179:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129186:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129192:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129197:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129203:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129210:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129217:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129222:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129228:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129318:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129325:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129331:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129338:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129343:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129349:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129353:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129358:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129363:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129368:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868826.129374:0:15301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787868826.138426:0:15301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868826.138440:0:15301:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787868826.138446:0:15301:0:(genops.c:885:class_export_put()) final put ffff93dab01ba000/MDS_uuid 00000020:00000080:2.0:1787868826.138450:0:15301:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab01ba000/MDS_uuid for MDS 00000020:01000000:2.0:1787868826.138456:0:15301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787868826.138595:0:15301:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787868826.722422:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868827.745406:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787868827.938942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868827.938952:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868827.938955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868827.938968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787868827.938972:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868827.938980:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1787868827.938986:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787868827.938993:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d986e3e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868827.939034:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab700e940 x1874715939613696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868827.939344:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939613824:0@lo:400:kworker.0 00000400:00000100:3.0:1787868827.939398:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939613824 offset 0 length 224: 4 00000100:00080000:0.0:1787868827.939497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868827.939502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787868827.939504:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868827.939508:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1787868827.939512:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787868827.939516:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93dabec6f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868827.939532:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab700e580 x1874715939613952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868827.939568:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868827.939591:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614080:0@lo:400:kworker.0 00000400:00000100:0.0:1787868827.939614:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614080 offset 0 length 224: 4 00000100:00100000:1.0:1787868827.939997:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939613696:0@lo:38:kworker.0 00000400:00000100:1.0:1787868827.940020:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939613696 offset 0 length 520: 4 00000100:00100000:1.0:1787868827.940033:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939613952:0@lo:38:kworker.0 00000400:00000100:1.0:1787868827.940118:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939613952 offset 0 length 520: 4 00010000:00010000:0.0:1787868828.771483:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868829.795428:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868829.985979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868829.985987:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868829.985990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868829.985993:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868829.986037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868829.986040:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868829.986224:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868829.986245:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939614208:0@lo:400:kworker.0 00000400:00000100:1.0:1787868829.986300:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614208 offset 0 length 224: 4 00000100:00100000:1.0:1787868829.986353:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939614336:0@lo:400:kworker.0 00000400:00000100:1.0:1787868829.986371:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614336 offset 0 length 224: 4 00000020:01000004:2.0:1787868830.723859:0:15502:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787868830.744766:0:15502:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787868830.744823:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868830.744840:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868830.744849:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868830.744858:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868830.745428:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868830.745436:0:15502:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787868830.745469:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868830.745484:0:15502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700e940 x1874715939613696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787868842 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868830.745549:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868830.745556:0:15502:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787868830.745563:0:15502:0:(import.c:65:import_set_state_nolock()) ffff93d986e3e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787868830.745568:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868830.745572:0:15502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700e940 x1874715939613696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787868842 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787868830.745616:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868830.745623:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868830.745631:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1bc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868830.745635:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868830.745658:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868830.745666:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868830.745671:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868830.745673:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787868830.745676:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787868830.745690:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:0.0:1787868830.745694:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868830.745699:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2d062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868830.745711:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868830.745713:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868830.745715:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868830.745942:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787868830.745966:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939613696:0@lo:38:kworker.0 00000100:00100000:3.0:1787868830.746029:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787868830.748473:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787868830.748490:0:15502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700cb40 x1874715939613824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868830.748813:0:15502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393d680 x1874715939614208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868845 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868830.748835:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868830.748841:0:15502:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787868830.748868:0:15502:0:(import.c:65:import_set_state_nolock()) ffff93d986fa6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787868830.748962:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939614208:0@lo:400:kworker.0 00000100:00100000:2.0:1787868830.749040:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939614464:0@lo:39:umount.0 00000400:00000100:2.0:1787868830.749110:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614464 offset 0 length 224: 4 00000100:00100000:0.0:1787868830.750234:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939613824:0@lo:400:kworker.0 00010000:00010000:0.0:1787868830.817283:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868831.841501:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787868832.035997:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787868832.036006:0:9508:0:(genops.c:885:class_export_put()) final put ffff93dab7ec8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787868832.036071:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ec8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787868832.036126:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7ecb000 for lustre-OST0001 00010000:00010000:0.0:1787868832.865313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787868832.993366:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868832.993377:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868832.993380:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868832.993384:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868832.993508:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868832.993531:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939614592:0@lo:400:kworker.0 00000400:00000100:1.0:1787868832.993594:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614592 offset 0 length 224: 4 00010000:00010000:0.0:1787868833.889832:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868834.913803:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868835.873691:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868825/real 1787868825] req@ffff93da9393ed00 x1874715939613568/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787868835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868835.873729:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da9393ed00 x1874715939613568/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787868835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787868835.873751:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daae791000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868835.873788:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787868835.873793:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939613568:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1787868835.873992:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868835.874016:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787868835.874018:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93daae791000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787868835.874024:0:13937:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787868835.874030:0:13937:0:(import.c:589:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787868835.874037:0:13937:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93daae791000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868835.874068:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393d680 x1874715939614720/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868835.874094:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868835.874098:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787868835.874280:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868835.874305:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614848:0@lo:400:kworker.0 00000400:00000100:0.0:1787868835.874360:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614848 offset 0 length 224: 4 00000100:00100000:2.0:1787868835.875211:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939614720:0@lo:250:kworker.0 00000400:00000100:2.0:1787868835.875242:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939614720 offset 0 length 520: 4 00010000:00010000:0.0:1787868835.937332:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868836.961786:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868837.985422:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868839.009342:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868840.033320:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868840.993512:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868830/real 1787868830] req@ffff93d9881903c0 x1874715939614464/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868840.993574:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d9881903c0 x1874715939614464/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868840 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787868840.993599:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986fa6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787868840.993620:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939614464:0@lo:39:umount.0 00000100:00080000:3.0:1787868840.994179:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787868840.994185:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868840.994191:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787868840.995625:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995662:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995670:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995677:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995753:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868840.995762:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995770:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995777:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868840.995783:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.995919:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868840.995927:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.995935:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868840.995939:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.995946:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868840.995953:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868840.995959:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868840.995961:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787868840.995973:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:2.0:1787868840.995977:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.995983:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2d070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d077 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.996010:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868840.996013:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.996027:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1be00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868840.996030:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.996037:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868840.996043:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868840.996047:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787868840.996050:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787868840.996054:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:2.0:1787868840.996057:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868840.996064:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868840.996066:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868840.996068:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868840.996297:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787868840.996302:0:15502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2d2f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d2fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868840.996312:0:15502:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787868840.996317:0:15502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787868840.996319:0:15502:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787868840.996348:0:15502:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787868840.996352:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787868840.996357:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868840.996363:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787868840.996367:0:15502:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93d9863d1a48) has no exports 00000020:00080000:3.0:1787868840.996390:0:15502:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93d9863d1a48) has no exports 00010000:00010000:0.0:1787868840.997458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787868840.998465:0:15502:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d98224bea0 - data ffff93daafa8ca20/ffff93d987eed400 00000020:01000000:3.0:1787868840.998649:0:15502:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da8ffed9c0 - data ffff93daafaa8d80/ffff93dab6f89000 00100000:10000000:3.0:1787868841.004613:0:15502:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787868841.031134:0:15502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cdc2 00000020:00000080:1.0:1787868841.031147:0:15502:0:(genops.c:885:class_export_put()) final put ffff93dab6e08800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787868841.031228:0:15502:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab5b24800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787868841.031236:0:15502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab5b24800 2 00000020:01000004:1.0:1787868841.031240:0:15502:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93dab5b24800 from lustre-OST0000 00000020:00000080:1.0:1787868841.031262:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868841.031272:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787868841.031275:0:15502:0:(genops.c:885:class_export_put()) final put ffff93dab6e0a800/lustre-OST0000_UUID 00000020:00000080:1.0:1787868841.031278:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e0a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787868841.031284:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787868841.031331:0:15502:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787868841.031335:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787868841.031338:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868841.031342:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787868841.031348:0:15502:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93d986e3b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787868841.031354:0:15502:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff93d986e48000) has exports, disconnecting them 00000020:00080000:1.0:1787868841.031358:0:15502:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93d986e3b800), last request at 1787868583 00000020:00000080:1.0:1787868841.031362:0:15502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cdec 00000020:00080000:1.0:1787868841.031377:0:15502:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986e3b800): rc 0 00000020:00000080:1.0:1787868841.031381:0:15502:0:(genops.c:885:class_export_put()) final put ffff93d986e3b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787868841.031731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e08800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787868841.031746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986e3b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787868841.037067:0:15502:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787868841.037077:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787868841.037081:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787868841.037089:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868841.037130:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986e3e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787868841.037295:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868841.037307:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787868841.037313:0:15502:0:(genops.c:885:class_export_put()) final put ffff93d986e3e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787868841.037317:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986e3e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787868841.037323:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787868841.037399:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787868841.037403:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868841.037408:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787868841.037416:0:15502:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93d986e3a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787868841.037422:0:15502:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff93d9863d4ed8) has exports, disconnecting them 00000020:00080000:1.0:1787868841.037426:0:15502:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93d986e3a000), last request at 1787868583 00000020:00000080:1.0:1787868841.037430:0:15502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ce01 00000020:00080000:1.0:1787868841.037443:0:15502:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986e3a000): rc 0 00000020:00000080:1.0:1787868841.037447:0:15502:0:(genops.c:885:class_export_put()) final put ffff93d986e3a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787868841.037535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986e3a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787868841.039337:0:15502:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787868841.039347:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787868841.039352:0:15502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787868841.039359:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868841.039626:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868841.039636:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787868841.039643:0:15502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab5b24800 1 00000020:00000080:0.0:1787868841.039650:0:15502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cd8a 00000020:00000080:0.0:1787868841.039658:0:15502:0:(genops.c:885:class_export_put()) final put ffff93dabda30800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787868841.039689:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986fa6800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787868841.039696:0:8:0:(genops.c:885:class_export_put()) final put ffff93dab6e0b800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787868841.039700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e0b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787868841.039710:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:0.0:1787868841.039932:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787868841.039937:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868841.039942:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787868841.039946:0:15502:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff93daaf714ed8) has no exports 00000020:00000080:2.0:1787868841.042990:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda30800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:0.0:1787868841.058345:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787868841.076615:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868841.076635:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787868841.076642:0:15502:0:(genops.c:885:class_export_put()) final put ffff93dab59ec800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787868841.076647:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab59ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787868841.076663:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787868841.076892:0:15502:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93dab5b25000 00000020:02000400:3.0:1787868841.077084:0:15502:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1787868841.251364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868841.251375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868841.251378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868841.251403:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868841.251514:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614976:0@lo:400:kworker.0 00000400:00000100:1.0:1787868841.251576:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939614976 offset 0 length 224: 4 00000100:00100000:2.0:1787868842.018211:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868827/real 1787868827] req@ffff93dab700e580 x1874715939613952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787868842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868842.018253:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab700e580 x1874715939613952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787868842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787868842.018275:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868842.018303:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787868842.018308:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939613952:0@lo:38:kworker.0 00000100:00080000:0.0:1787868842.018383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868842.018389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868842.018392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868842.018396:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787868842.018399:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868842.018403:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1787868842.018409:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787868842.018416:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93dabec6f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868842.018450:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab700f840 x1874715939615104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868842.018515:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868842.018530:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939615232:0@lo:400:kworker.0 00000400:00000100:0.0:1787868842.018587:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939615232 offset 0 length 224: 4 00000100:00100000:2.0:1787868842.018710:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939615104:0@lo:38:kworker.0 00000400:00000100:2.0:1787868842.018736:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939615104 offset 0 length 520: 4 00010000:00010000:2.0:1787868842.089458:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868843.106675:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787868843.301273:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868827/real 1787868827] req@ffff93dab700ed00 x1874715939614080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868843 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868843.348518:0:3639:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93dab700ed00 x1874715939614080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868843 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868843.348536:0:3639:0:(import.c:65:import_set_state_nolock()) ffff93dabd86f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787868843.348540:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787868843.367589:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1787868843.367669:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868843.367676:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868843.367680:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868843.367683:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868843.367702:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787868843.367706:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787868843.367710:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93dabd86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787868843.367719:0:13937:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 229 00000100:00080000:1.0:1787868843.367730:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93dabd86f000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868843.367775:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393da40 x1874715939615360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868843.367846:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614080:0@lo:400:kworker.0 00000100:00100000:3.0:1787868843.368212:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939615360:0@lo:38:kworker.0 00000400:00000100:3.0:1787868843.368343:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939615360 offset 0 length 520: 4 00010000:00010000:0.0:1787868844.129460:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868845.156503:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868845.329728:0:15704:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787868845.339309:0:15704:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787868845.339405:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868845.339421:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868845.339429:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868845.339437:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868845.339487:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868845.339494:0:15704:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787868845.339522:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868845.339535:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700f840 x1874715939615104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787868862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.339551:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868845.339586:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787868845.339590:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1787868845.339595:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939615104:0@lo:38:kworker.0 00000100:00080000:3.0:1787868845.339623:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787868845.339628:0:15704:0:(import.c:65:import_set_state_nolock()) ffff93dabec6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787868845.339633:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868845.339635:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868845.339639:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787868845.340502:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787868845.340513:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393cf00 x1874715939614336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868845 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340543:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700cb40 x1874715939614592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340552:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393de00 x1874715939614848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868851 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340565:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700cf00 x1874715939614976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868857 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340572:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700c3c0 x1874715939615232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868858 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340606:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393da40 x1874715939615360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787868853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340615:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868845.340646:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dabd86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787868845.340650:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1787868845.340654:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939615360:0@lo:38:kworker.0 00000100:00080000:3.0:1787868845.340673:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787868845.340677:0:15704:0:(import.c:65:import_set_state_nolock()) ffff93dabd86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787868845.340680:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787868845.340684:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393cf00 x1874715939614336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868845 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340692:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700cb40 x1874715939614592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868848 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340700:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393de00 x1874715939614848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868851 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340706:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700cf00 x1874715939614976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868857 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340713:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab700c3c0 x1874715939615232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868858 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868845.340719:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868845.340722:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1787868845.340878:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868845.340888:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.340897:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868845.340901:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.340911:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868845.340918:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868845.340924:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868845.340927:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787868845.340938:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787868845.340955:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:2.0:1787868845.340959:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.340978:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2070e00/0x2f11f4d3bde2d046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d04d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.340994:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868845.340995:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868845.340997:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868845.341198:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939615232:0@lo:400:kworker.0 00000100:00000400:1.0:1787868845.341572:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868829/real 1787868829] req@ffff93da9393cf00 x1874715939614336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868845 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868845.348225:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614976:0@lo:400:kworker.0 00000100:00100000:2.0:1787868845.348245:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939614848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868845.370058:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=FULL (now=CLOSED) req@ffff93da9393cf00 x1874715939614336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787868845 ref 1 fl Rpc:EXNQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868845.370092:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939614592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868845.370116:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939614336:0@lo:400:kworker.0 00010000:00010000:2.0:1787868845.371439:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371458:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371467:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371474:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371498:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868845.371505:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371533:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371539:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371546:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371573:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787868845.371578:0:15704:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787868845.371602:0:15704:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787868845.371607:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1787868845.371625:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868845.371631:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371638:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868845.371643:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371651:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868845.371658:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868845.371664:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868845.371666:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787868845.371675:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787868845.371693:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:2.0:1787868845.371698:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371704:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2070600/0x2f11f4d3bde2d054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d05b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371719:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868845.371723:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371729:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868845.371731:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371738:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868845.371744:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868845.371749:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787868845.371752:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787868845.371753:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787868845.371758:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:2.0:1787868845.371761:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371779:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287c00/0x2f11f4d3bde2d2e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d2ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868845.371803:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868845.371805:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868845.371807:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787868845.371819:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868845.371825:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787868845.371829:0:15704:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93d9863d3490) has no exports 00000020:00080000:2.0:1787868845.371851:0:15704:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93d9863d3490) has no exports 00010000:00010000:1.0:1787868845.372859:0:7921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787868845.377539:0:15704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93daa043bae0 - data ffff93d986428af8/ffff93d98717c800 00000020:01000000:3.0:1787868845.377843:0:15704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93daa043ba20 - data ffff93daafb45798/ffff93d988029c00 00100000:10000000:2.0:1787868845.397091:0:15704:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787868845.406229:0:15704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cee8 00000020:00000080:3.0:1787868845.406242:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dab6e0e000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787868845.406275:0:15704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dabec41000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787868845.406280:0:15704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dabec41000 2 00000020:01000004:3.0:1787868845.406283:0:15704:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93dabec41000 from lustre-OST0001 00000020:00000080:3.0:1787868845.406304:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868845.406314:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787868845.406318:0:15704:0:(genops.c:885:class_export_put()) final put ffff93d986317000/lustre-OST0001_UUID 00000020:00000080:3.0:1787868845.406321:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986317000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787868845.406327:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787868845.406441:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f->MGS 00010000:00010000:3.0:1787868845.406460:0:15704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031400/0x2f11f4d3bde2cc41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868845.406474:0:15704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031400/0x2f11f4d3bde2cc41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868845.406481:0:15704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787868845.406485:0:15704:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787868845.406489:0:15704:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787868845.406504:0:15704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:3.0:1787868845.406508:0:15704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031400/0x2f11f4d3bde2cc41 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2cc48 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868845.406523:0:15704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868845.406530:0:15704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868845.406536:0:15704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787868845.406538:0:15704:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787868845.406539:0:15704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787868845.406557:0:15704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93daae791000 00010000:00010000:3.0:1787868845.406566:0:15704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2d0b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2d0bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787868845.406584:0:15704:0:(import.c:65:import_set_state_nolock()) ffff93daae791000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787868845.406588:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787868845.406591:0:15704:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787868845.406592:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787868845.406596:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787868845.406609:0:15704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93da9393d680 x1874715939614720/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787868850 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787868845.406639:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787868845.406642:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:1.0:1787868845.406705:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e0e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787868845.406758:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ab643b8-e79b-48a9-8c56-a948f1a1bf9f:3635:1874715939614720:0@lo:250:kworker.0 10000000:01000000:3.0:1787868845.406985:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787868845.406993:0:15704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cb3e 00000020:00000080:3.0:1787868845.406998:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dab01b9800/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f 00000020:01000000:3.0:1787868845.407012:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.127@tcp (flags='') 00000020:00000080:3.0:1787868845.407017:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868845.407021:0:15704:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787868845.407025:0:15704:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93daae688000) has no exports 00000020:00000080:1.0:1787868845.407062:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab01b9800/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f for MGC192.168.204.127@tcp 10000000:01000000:1.0:1787868845.407084:0:6510:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787868845.407176:0:15704:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.127@tcp: client import never connected 00000100:00080000:3.0:1787868845.407180:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787868845.407182:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787868845.407185:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787868845.407187:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787868845.407219:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868845.407224:0:15704:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.127@tcp (uuid 6ab643b8-e79b-48a9-8c56-a948f1a1bf9f) 00000020:01000000:3.0:1787868845.407228:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787868845.407232:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868845.407235:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787868845.407240:0:15704:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93dabec68000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868845.407245:0:15704:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff93dab59f1a48) has exports, disconnecting them 00000020:00080000:3.0:1787868845.407250:0:15704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93dabec68000), last request at 1787868605 00000020:00000080:3.0:1787868845.407262:0:15704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf12 00000020:00080000:3.0:1787868845.407271:0:15704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dabec68000): rc 0 00000020:00000080:3.0:1787868845.407274:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dabec68000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787868845.408319:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daae791000 for MGC192.168.204.127@tcp 00000020:00000080:1.0:1787868845.408329:0:36:0:(genops.c:885:class_export_put()) final put ffff93daae794000/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f 00000020:00000080:1.0:1787868845.408332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93daae794000/6ab643b8-e79b-48a9-8c56-a948f1a1bf9f for MGC192.168.204.127@tcp 00000020:01000000:1.0:1787868845.408338:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.127@tcp (6ab643b8-e79b-48a9-8c56-a948f1a1bf9f) 00000020:00000080:1.0:1787868845.408573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec68000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787868845.412240:0:15704:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787868845.412250:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787868845.412255:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787868845.412264:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868845.412470:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868845.412480:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787868845.412489:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787868845.412496:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868845.412500:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787868845.412508:0:15704:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93dabec6e800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868845.412515:0:15704:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff93d988021a48) has exports, disconnecting them 00000020:00080000:0.0:1787868845.412519:0:15704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93dabec6e800), last request at 1787868605 00000020:00000080:0.0:1787868845.412523:0:15704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2cf27 00000020:00080000:0.0:1787868845.412539:0:15704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dabec6e800): rc 0 00000020:00000080:0.0:1787868845.412545:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dabec6e800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787868845.413207:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabec6f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787868845.413217:0:36:0:(genops.c:885:class_export_put()) final put ffff93dab7eca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787868845.413220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7eca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787868845.413226:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787868845.413293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6e800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787868845.413328:0:15704:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787868845.413332:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787868845.413334:0:15704:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787868845.413339:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787868845.413356:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dabd86f000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787868845.433241:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787868845.434459:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787868845.434658:0:7921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787868845.496286:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93da82e06a00:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1787868845.514669:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93daa0cfae00:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1787868845.515078:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.515483:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93daafd84400:6499] 2 exiting: rc = 0 00000100:00100000:1.0:1787868845.515542:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93da82900400:6497] 0 exiting: rc = 1 00000100:00100000:0.0:1787868845.517009:0:7463:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93dab6dfdc00:7463] 3 exiting: rc = 0 00000100:00100000:0.0:1787868845.530347:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93daa0cfbc00:6498] 1 exiting: rc = 0 00000100:00100000:1.0:1787868845.530533:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530544:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530552:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530560:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530567:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530572:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530579:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530585:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530591:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530598:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530604:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530610:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530618:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530963:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530969:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530974:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530980:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530986:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530993:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.530999:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531005:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531009:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531014:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531020:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531025:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531030:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531035:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531041:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531047:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531053:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531057:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531063:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531068:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531073:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531078:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531084:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531090:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531095:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531101:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531107:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531112:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531118:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531123:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531129:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531134:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531140:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531145:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531150:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531301:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531306:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531311:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531318:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531323:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531329:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531334:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531340:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531345:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531350:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531355:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531361:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531366:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531371:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531376:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.531382:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787868845.533511:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868845.533528:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787868845.533534:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dabec6f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787868845.533543:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec6f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787868845.533548:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787868845.533743:0:15704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dabec41000 1 00000020:00000080:1.0:1787868845.533750:0:15704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2ceb7 00000020:00000080:1.0:1787868845.533760:0:15704:0:(genops.c:885:class_export_put()) final put ffff93d986310800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787868845.533843:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787868845.533852:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868845.533858:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787868845.533976:0:15704:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff93d986e49a48) has no exports 00000020:00000080:0.0:1787868845.538597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986310800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787868845.581893:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868845.581910:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787868845.581916:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dabec43000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787868845.581921:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabec43000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787868845.581929:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787868845.582334:0:15704:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93dabec47800 00000020:01000000:1.0:1787868845.582356:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787868845.582361:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868845.582365:0:15704:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787868845.582369:0:15704:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93dabda58000) has no exports 00000020:00000080:1.0:1787868845.582409:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868845.582415:0:15704:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787868845.582419:0:15704:0:(genops.c:885:class_export_put()) final put ffff93dabda34800/OSS_uuid 00000020:00000080:1.0:1787868845.582421:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff93dabda34800/OSS_uuid for OSS 00000020:01000000:1.0:1787868845.582425:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787868845.582515:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93dabeb15c00:8429] 0 exiting: rc = 1 00000100:00100000:1.0:1787868845.582626:0:8962:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93dab6e24400:8962] 3 exiting: rc = 0 00000100:00100000:1.0:1787868845.582676:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93dabda15200:8430] 1 exiting: rc = 0 00000100:00080000:2.0:1787868845.582792:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787868845.583240:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93dabd826800:8431] 2 exiting: rc = 0 00000100:00100000:1.0:1787868845.583406:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583422:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583430:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583439:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583446:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583451:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583457:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583462:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583466:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583471:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583475:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583480:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583486:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583491:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583498:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583503:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583510:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583515:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583520:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583526:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583531:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583553:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583557:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583562:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583566:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583570:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583575:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583580:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583585:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583589:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583594:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583599:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583605:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583610:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583615:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583687:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583695:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583700:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583705:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583709:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583714:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583719:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583723:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583728:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583733:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583739:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583746:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583751:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583757:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583772:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583778:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583783:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583789:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583794:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583799:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583805:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583818:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583824:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583829:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583834:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583840:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583846:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583851:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.583937:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.585502:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93dabd827400:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1787868845.585659:0:13387:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93dab6f79600:13387] 2 exiting: rc = 0 00000100:00100000:3.0:1787868845.585743:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93dabda14c00:8432] 0 exiting: rc = 1 00000100:00100000:1.0:1787868845.586287:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586298:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586305:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586310:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586315:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586320:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586326:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586342:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586349:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586355:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586359:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586364:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586370:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586375:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586381:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586387:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586393:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586399:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586405:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586411:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586416:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586421:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586426:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586431:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586437:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586442:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586462:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586467:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586472:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586477:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586482:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586487:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586492:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586497:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586502:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586507:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586512:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586517:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586522:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586527:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586533:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586539:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586543:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586547:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586552:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586557:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586561:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586566:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586571:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586575:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586580:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586585:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586590:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586596:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586601:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586606:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586611:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586616:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586621:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586626:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586630:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586643:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586647:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.586653:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.587760:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93dabee96e00:8436] 2 exiting: rc = 0 00000100:00100000:0.0:1787868845.588223:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93dabee96600:8434] 0 exiting: rc = 1 00000100:00100000:3.0:1787868845.588493:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93dabee96800:8435] 1 exiting: rc = 0 00000100:00100000:1.0:1787868845.588606:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588614:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588620:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588626:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588631:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588637:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588652:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588661:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588667:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588673:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588679:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588685:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588692:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588699:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588705:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588728:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588735:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588742:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588749:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588755:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588771:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588779:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588784:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588789:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588796:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588802:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588808:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588814:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588820:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588826:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588833:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.588856:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589003:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589011:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589017:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589023:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589029:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589035:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589042:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589067:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589074:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589080:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589085:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589091:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589096:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589101:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589107:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589112:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589117:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589123:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589128:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589133:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589138:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589144:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589150:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589453:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589460:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589466:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589471:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589477:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589482:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589488:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589494:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.589499:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868845.603350:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93dabee96200:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1787868845.608745:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93dabee96a00:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1787868845.608979:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.608986:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609005:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609009:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609014:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609019:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609024:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609029:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609034:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609039:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609044:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609049:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609055:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609061:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609065:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609070:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609075:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609081:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609086:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609091:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609096:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609101:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609106:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609110:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609115:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609119:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609125:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609130:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609137:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609142:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609147:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609185:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609192:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609198:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609203:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609208:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609213:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609228:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609232:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609289:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609295:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609300:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609306:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609312:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609317:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609324:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609330:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609335:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609340:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609347:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609351:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609358:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609364:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609370:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609375:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609380:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609386:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609391:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609397:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609402:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609408:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609413:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609419:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.609425:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868845.610452:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93dab5be3800:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1787868845.610684:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93dabee97a00:8439] 0 exiting: rc = 1 00000100:00100000:1.0:1787868845.610790:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610805:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610812:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610818:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610824:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610846:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610936:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610944:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610963:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610969:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610975:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610980:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610986:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610992:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.610999:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611005:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611011:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611017:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611039:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611047:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611054:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611060:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611067:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611073:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611079:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611085:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611093:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611099:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611105:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611111:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611133:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611141:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611147:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611382:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611392:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611398:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611404:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611410:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611416:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611422:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611428:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611435:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611459:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611474:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611481:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611486:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611493:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611499:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611505:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611511:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611517:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611524:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611530:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611536:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611558:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611566:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611572:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611579:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611585:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611590:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611596:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611603:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611609:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868845.611623:0:15704:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787868845.638101:0:15704:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787868868.750881:0:16468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787868879.573518:0:17067:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787868879.573525:0:17067:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787868879.573527:0:17067:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787868879.573643:0:17067:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93daa05e9800 00000020:01000004:2.0:1787868879.573660:0:17067:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787868879.573668:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787868879.573681:0:17067:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93d988024ed8) 00000020:00000080:2.0:1787868879.573694:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787868879.695047:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787868879.696991:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.700869:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787868879.701902:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787868879.705441:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787868879.705884:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787868879.706149:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787868879.709767:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.710130:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.710448:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.710856:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.711133:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.711410:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787868879.711820:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.715618:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787868879.716960:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787868879.720462:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787868879.726400:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787868879.726956:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787868879.727275:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787868879.727538:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787868879.727848:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787868879.728068:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.733406:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.734311:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.734557:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.734831:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.735008:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.735878:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.736125:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.736659:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.736844:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.737066:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.737888:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.738140:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.739059:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.743953:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.744374:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.744915:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.750371:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.751430:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.751761:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.752113:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.752484:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.752792:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787868879.752996:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.753280:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787868879.756262:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787868879.758382:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787868879.758874:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787868879.767570:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787868879.767916:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787868879.768192:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1787868879.768970:0:17067:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787868879.769298:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787868879.769306:0:17067:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787868879.769318:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e0fb 00000020:01000004:2.0:1787868879.769323:0:17067:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787868879.769328:0:17067:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787868879.769334:0:17067:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93daa05e9800 from MGS 00000020:01000004:2.0:1787868879.769337:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787868879.769347:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93d988023490) 00000020:00000080:2.0:1787868879.769358:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787868879.769420:0:17067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93daa05e9800 from MGS, refs=2 00080000:01000000:2.0:1787868879.769425:0:17067:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787868879.769430:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e109 00000100:00100000:2.0:1787868879.769534:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787868879.769678:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787868879.769686:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787868879.777132:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787868879.777148:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787868879.777976:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787868879.778300:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787868879.778307:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787868879.783790:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787868879.783808:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787868879.787017:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787868879.787038:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787868879.788189:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868879.788211:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868879.788213:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868879.789451:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868879.789456:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868879.789458:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868879.789996:0:17067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1787868879.804749:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787868879.807679:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787868879.807737:0:17067:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787868879.807797:0:17067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:0.0:1787868879.809419:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1787868879.811174:0:17067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787868879.812029:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787868879.815999:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787868879.816013:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787868879.817049:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787868879.817060:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787868879.819395:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787868879.819408:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787868879.823179:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787868879.823217:0:17067:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:3.0:1787868879.823219:0:17067:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787868879.823259:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:3.0:1787868879.823274:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (ffff93dabd849a48) 00000020:00000080:3.0:1787868879.823295:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787868879.823401:0:17067:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d989103000@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00000100:00080000:2.0:1787868879.823838:0:17084:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1787868879.827695:0:17067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:3.0:1787868879.827712:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787868879.841765:0:17085:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787868879.841871:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 431a2c34-804b-46dd-9d1f-913354b6c612) 00000020:00000080:3.0:1787868879.841896:0:17067:0:(genops.c:1385:class_connect()) connect: client 431a2c34-804b-46dd-9d1f-913354b6c612, cookie 0x2f11f4d3bde2e117 00000100:00080000:3.0:1787868879.841908:0:17067:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868879.841915:0:17067:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93d989103000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868879.841949:0:17067:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988192940 x1874715939615488/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868879.841983:0:17067:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 431a2c34-804b-46dd-9d1f-913354b6c612->MGS 00000020:01000004:3.0:1787868879.842006:0:17067:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787868879.842028:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787868879.842041:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93dabd84ced8) 00000020:00000080:3.0:1787868879.842053:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787868879.845720:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939615488:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787868879.845808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868879.850252:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939615488 00000100:00100000:2.0:1787868879.850273:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939615488 00000100:00100000:2.0:1787868879.850320:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868879.850329:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3635:x1874715939615488:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787868879.850358:0:17082:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 431a2c34-804b-46dd-9d1f-913354b6c612@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1787868879.850388:0:17082:0:(genops.c:1385:class_connect()) connect: client 431a2c34-804b-46dd-9d1f-913354b6c612, cookie 0x2f11f4d3bde2e125 00000100:00080000:2.0:1787868879.850518:0:17082:0:(import.c:65:import_set_state_nolock()) ffff93daa7e3d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868879.850624:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+5:3635:x1874715939615488:12345-0@lo:250:mount.lustre.0 Request processed in 294us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868879.850632:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868879.850689:0:3635:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787868879.850698:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1787868879.850706:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787868879.850711:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787868879.850715:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787868879.850717:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787868879.850726:0:3635:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787868879.850731:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939615488:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787868879.866887:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868879.867078:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787868879.867084:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787868879.868793:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787868879.868805:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787868879.869605:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868879.869613:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787868879.870553:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868879.870740:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787868879.870745:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787868879.871478:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787868879.871486:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787868879.921053:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787868879.921892:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787868879.921901:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787868879.923503:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787868879.923517:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787868879.924302:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868879.924503:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868879.924509:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787868879.925209:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868879.925218:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787868879.925905:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868879.926063:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868879.926069:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787868879.927780:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868879.927792:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787868879.928819:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868879.928997:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787868879.929002:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787868879.929880:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787868879.929889:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787868879.974120:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787868879.976494:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787868879.976502:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787868879.987038:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787868879.989717:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787868879.993326:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868879.993348:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787868879.995707:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787868879.995755:0:17067:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787868879.995763:0:17067:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787868879.995904:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787868879.995941:0:17067:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787868879.995947:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787868879.995949:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787868879.995950:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868879.995952:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868879.995953:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868879.995954:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868879.995955:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787868879.995958:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787868879.995959:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868879.995961:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787868879.995963:0:17067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787868879.995965:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868879.995967:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787868879.995968:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868879.995969:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868879.995970:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868879.995971:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868879.995972:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787868879.995973:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787868879.995975:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868879.995975:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787868879.996009:0:17067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787868879.996033:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787868879.996134:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868879.996208:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939615616 00000100:00100000:3.0:1787868879.996216:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939615616 00000100:00100000:0.0:1787868879.996229:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868879.996258:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868879.996268:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+5:17067:x1874715939615616:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787868879.996324:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787868879.996327:0:17083:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787868879.996330:0:17083:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787868879.996873:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787868879.997778:0:17083:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787868880.003859:0:17105:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787868880.003869:0:17105:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787868880.003872:0:17105:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787868880.003875:0:17105:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787868880.004200:0:17105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787868880.004749:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787868880.004760:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787868880.011478:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+5:17067:x1874715939615616:12345-0@lo:253:mount.lustre.0 Request processed in 15200us (15333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.011493:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868880.013909:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787868880.013934:0:17067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787868880.013937:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787868880.013940:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787868880.013941:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787868880.013943:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787868880.013944:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787868880.013946:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787868880.013947:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787868880.013949:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787868880.013951:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787868880.013952:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787868880.013979:0:17067:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93daa05e9800 from lustre-MDT0000 10000000:01000000:2.0:1787868880.014022:0:17067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787868880.014026:0:17067:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787868880.014030:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93dabd849a48 10000000:01000000:2.0:1787868880.014049:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787868880.014058:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93dabd849a48 from 1 10000000:01000000:2.0:1787868880.014061:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787868880.014118:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.014130:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.014141:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.014180:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787868880.014247:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.014346:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.020305:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939615744 00000100:00100000:3.0:1787868880.020320:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939615744 00000100:00100000:3.0:1787868880.020391:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868880.020401:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+5:17067:x1874715939615744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868880.020420:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868880.020444:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828ca00/0x2f11f4d3bde2e133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e12c expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.020474:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828ca00/0x2f11f4d3bde2e133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e12c expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.020617:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828ca00/0x2f11f4d3bde2e133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e12c expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.020629:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ca00, rc 0) 00000100:00100000:3.0:1787868880.020721:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+6:17067:x1874715939615744:12345-0@lo:101:mount.lustre.0 Request processed in 321us (6473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.020728:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868880.020770:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868880.020790:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.020800:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.020879:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868880.020916:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.020953:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.021020:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939615872 00000100:00100000:3.0:1787868880.021024:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939615872 00000100:00100000:3.0:1787868880.021055:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868880.021062:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+6:17067:x1874715939615872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868880.021151:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+6:17067:x1874715939615872:12345-0@lo:501:mount.lustre.0 Request processed in 89us (235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787868880.021186:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868880.021188:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939615872:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787868880.021219:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787868880.021301:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.021316:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868880.021326:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93daa05e9800 10000000:01000000:2.0:1787868880.021331:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787868880.021336:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93daa05e9800 10000000:01000000:2.0:1787868880.021339:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787868880.021343:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93daa05e9800 from 1 10000000:01000000:2.0:1787868880.021346:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787868880.021377:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.021384:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.021392:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.021405:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787868880.021433:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.021460:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.021635:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616000 00000100:00100000:3.0:1787868880.021639:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616000 00000100:00100000:3.0:1787868880.021671:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868880.021678:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+6:17067:x1874715939616000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868880.021685:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868880.021696:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828dc00/0x2f11f4d3bde2e141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e13a expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.021713:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828dc00/0x2f11f4d3bde2e141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e13a expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.021721:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828dc00/0x2f11f4d3bde2e141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e13a expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.021727:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828dc00, rc 0) 00000100:00100000:3.0:1787868880.021766:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+7:17067:x1874715939616000:12345-0@lo:101:mount.lustre.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.021771:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787868880.022326:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868880.022344:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.022356:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868880.022371:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787868880.022378:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.022385:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868880.022393:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787868880.022398:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868880.022403:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93daa05e9800 10000000:01000000:0.0:1787868880.022406:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787868880.022409:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787868880.022412:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787868880.022434:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.022442:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.022471:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868880.022488:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868880.022526:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868880.022564:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.022812:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616128 00000100:00100000:3.0:1787868880.022818:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616128 00000100:00100000:3.0:1787868880.022864:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787868880.022873:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+7:17067:x1874715939616128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868880.022891:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868880.022904:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828d600/0x2f11f4d3bde2e14f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e148 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.022922:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828d600/0x2f11f4d3bde2e14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e148 expref: 8 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.022932:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828d600/0x2f11f4d3bde2e14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e148 expref: 8 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.022939:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d600, rc 0) 00000100:00100000:3.0:1787868880.022983:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+8:17067:x1874715939616128:12345-0@lo:101:mount.lustre.0 Request processed in 111us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.022989:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868880.023066:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868880.023078:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.023329:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868880.023397:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868880.023428:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868880.023459:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868880.023479:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616256 00000100:00100000:2.0:1787868880.023485:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616256 00000100:00100000:2.0:1787868880.023522:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787868880.023532:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+8:17067:x1874715939616256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868880.023699:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+9:17067:x1874715939616256:12345-0@lo:501:mount.lustre.0 Request processed in 168us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868880.023708:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787868880.023729:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868880.023763:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868880.023803:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868880.023823:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9385cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.024320:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616384 00000100:00100000:3.0:1787868880.024326:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616384 00000100:00100000:3.0:1787868880.024365:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787868880.024373:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+9:17067:x1874715939616384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787868880.025467:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+9:17067:x1874715939616384:12345-0@lo:503:mount.lustre.0 Request processed in 1090us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.025478:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787868880.025849:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939616384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787868880.026970:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17106:1874715939616512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868880.027044:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868880.027093:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987ec9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868880.028216:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616512 00000100:00100000:2.0:1787868880.028226:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616512 00000100:00100000:2.0:1787868880.028280:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868880.028290:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+9:17106:x1874715939616512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.029479:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+9:17106:x1874715939616512:12345-0@lo:502:llog_process_th.0 Request processed in 1185us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868880.029490:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868880.029605:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17106:1874715939616512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787868880.029646:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.029753:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.029756:0:17106:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787868880.029762:0:17106:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787868880.029765:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868880.029780:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93d988020000) 00000020:00000080:2.0:1787868880.029796:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787868880.029801:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787868880.029891:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787868880.029901:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e15d 00000020:00000080:2.0:1787868880.030248:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787868880.030253:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.030257:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.030258:0:17106:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787868880.030261:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.030265:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.030266:0:17106:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787868880.030268:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868880.030276:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93d988021a48) 00000020:00000080:2.0:1787868880.030285:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787868880.030288:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787868880.030290:0:17106:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787868880.030293:0:17106:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787868880.030299:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787868880.030336:0:17106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93daa05e9800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787868880.030355:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93dabd2fb490) 00000020:00000080:2.0:1787868880.030367:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787868880.030423:0:17106:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787868880.030428:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e172 00000020:00000080:2.0:1787868880.030517:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787868880.030524:0:17106:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787868880.030528:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f11f4d3bde2e179 00080000:01000000:2.0:1787868880.030533:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787868880.030536:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e180 00010000:00010000:0.0:1787868880.123759:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787868880.126017:0:17106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1787868880.126544:0:17106:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787868880.127023:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93d9863d3490) 00000020:00000080:0.0:1787868880.127044:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787868880.127136:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787868880.127143:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e18e 00000020:00000080:3.0:1787868880.133432:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787868880.149383:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f11f4d3bde2e195 00000020:00000080:0.0:1787868880.150088:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787868880.150108:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868880.150115:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868880.150117:0:17106:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787868880.150123:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787868880.150127:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787868880.150129:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787868880.150130:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787868880.150132:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787868880.150135:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868880.150136:0:17106:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787868880.150139:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868880.150144:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868880.150146:0:17106:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787868880.150318:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787868880.150364:0:17106:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787868880.150452:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868880.150456:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868880.150458:0:17106:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787868880.150461:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868880.150465:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868880.150466:0:17106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787868880.150470:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787868880.150476:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:0.0:1787868880.150504:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868880.150520:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93d9863d4ed8) 00000020:00000080:0.0:1787868880.150535:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787868880.150541:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787868880.150733:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787868880.150752:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787868880.150759:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e1a3 00010000:00080000:0.0:1787868880.150791:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab7f72800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787868880.154036:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787868880.155700:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868880.155719:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787868880.155762:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787868880.155787:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e1aa 00000100:00080000:1.0:1787868880.155805:0:17106:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868880.155813:0:17106:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93dab7f72800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868880.155855:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393cf00 x1874715939616640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868880.155951:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787868880.156041:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868880.156439:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787868880.156512:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868880.156518:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.156520:0:17106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787868880.156523:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787868880.156526:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787868880.156528:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868880.156530:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868880.156531:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787868880.156533:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.156534:0:17106:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787868880.156537:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787868880.156542:0:17106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787868880.156545:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.156547:0:17106:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787868880.156549:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787868880.156553:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787868880.156687:0:17106:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787868880.156691:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787868880.156705:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d986e49a48) 00000020:00000080:1.0:1787868880.156717:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787868880.156722:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787868880.156783:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787868880.156789:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787868880.156794:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e1b8 00010000:00080000:1.0:1787868880.156836:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab7ed8000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868880.157444:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787868880.157701:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939616640 00000100:00100000:3.0:1787868880.157712:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939616640 00000100:00100000:3.0:1787868880.157763:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868880.157773:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939616640:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787868880.157790:0:17093:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787868880.168041:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787868880.168506:0:17106:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787868880.171900:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868880.173544:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1787868880.192842:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939616640:12345-0@lo:38:llog_process_th.0 Request processed in 35056us (36788us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787868880.192858:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787868880.192985:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787868880.192991:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787868880.192995:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616640:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787868880.196830:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787868880.197692:0:17112:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787868880.197698:0:17112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787868880.201945:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868880.201964:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787868880.202015:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787868880.202039:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e1bf 00000100:00080000:1.0:1787868880.202053:0:17106:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868880.202060:0:17106:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93dab7ed8000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868880.202278:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393c780 x1874715939616768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868880.202315:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787868880.202421:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868880.202425:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.202427:0:17106:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787868880.202430:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787868880.202433:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787868880.202435:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868880.202436:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868880.202438:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787868880.202441:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.202442:0:17106:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787868880.202445:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787868880.202449:0:17106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787868880.202452:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.202454:0:17106:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787868880.202457:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787868880.202460:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787868880.202487:0:17106:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787868880.202490:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787868880.202500:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d986e48000) 00000020:00000080:1.0:1787868880.202511:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787868880.202516:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787868880.202596:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787868880.202602:0:17106:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787868880.202616:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2e1cd 00010000:00080000:1.0:1787868880.202646:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab6f68000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868880.202841:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787868880.202914:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787868880.202930:0:17106:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787868880.206662:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616768:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787868880.206733:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939616768 offset 0 length 520: 4 00000040:00080000:1.0:1787868880.208915:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868880.210891:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787868880.211489:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787868880.215062:0:17114:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787868880.215071:0:17114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787868880.222530:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787868880.222550:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787868880.222601:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787868880.222624:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e1d4 00000100:00080000:2.0:1787868880.222636:0:17106:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868880.222642:0:17106:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868880.222679:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a830c0 x1874715939616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868880.222720:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787868880.222796:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.222801:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.222803:0:17106:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787868880.222806:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.222810:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.222812:0:17106:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787868880.222815:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787868880.222817:0:17106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787868880.222820:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.222823:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.222840:0:17106:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787868880.222844:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.222848:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.222849:0:17106:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787868880.222854:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787868880.222891:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17106:1874715939617024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868880.223875:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616896:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787868880.223930:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939616896 offset 0 length 520: 4 00000100:00100000:2.0:1787868880.225364:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.225418:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03840 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.225777:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617024 00000100:00100000:3.0:1787868880.225788:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617024 00000100:00100000:3.0:1787868880.225848:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868880.225858:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+9:17106:x1874715939617024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787868880.226039:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+9:17106:x1874715939617024:12345-0@lo:502:llog_process_th.0 Request processed in 182us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.226060:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868880.226308:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17106:1874715939617024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787868880.226343:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.226351:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.226353:0:17106:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787868880.226359:0:17106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787868880.226424:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787868880.226448:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787868880.226527:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226540:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868880.226549:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05e9800 from 1 10000000:01000000:2.0:1787868880.226552:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787868880.226587:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226595:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226604:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.226633:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787868880.226670:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.226693:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da81254b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868880.226712:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617152 00000100:00100000:2.0:1787868880.226716:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617152 00000100:00100000:2.0:1787868880.226742:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868880.226748:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+9:17067:x1874715939617152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868880.226758:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868880.226772:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e1db expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226794:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226804:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226813:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030e00, rc 0) 00000100:00100000:2.0:1787868880.226843:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+10:17067:x1874715939617152:12345-0@lo:101:mount.lustre.0 Request processed in 95us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868880.226850:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868880.226887:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868880.226899:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.226908:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.228843:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787868880.228916:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868880.229684:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617280 00000100:00100000:3.0:1787868880.229693:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617280 00000100:00100000:3.0:1787868880.229751:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868880.229761:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+10:17067:x1874715939617280:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787868880.229781:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787868880.229789:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787868880.229868:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+10:17067:x1874715939617280:12345-0@lo:256:mount.lustre.0 Request processed in 109us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.229875:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868880.230435:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03840 going to sleep for 11 seconds 00000100:00100000:2.0:1787868880.230464:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617280:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787868880.232797:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787868880.236508:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.236530:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868880.236541:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05e9800 from 1 10000000:01000000:2.0:1787868880.236544:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868880.236594:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.236603:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.236616:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.236645:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787868880.236731:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.236781:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03840 going to sleep for 11 seconds 00000100:00100000:3.0:1787868880.238088:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617408 00000100:00100000:3.0:1787868880.238114:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617408 00000100:00100000:3.0:1787868880.238217:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868880.238228:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+10:17067:x1874715939617408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868880.238243:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868880.238261:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e1e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.238288:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 11 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.238299:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 11 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.238308:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868880.238373:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939617408:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.238380:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868880.238908:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868880.238936:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.238959:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.239051:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868880.239100:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.239139:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.239329:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617536 00000100:00100000:0.0:1787868880.239334:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617536 00000100:00100000:0.0:1787868880.239368:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787868880.239376:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939617536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868880.239517:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939617536:12345-0@lo:501:mount.lustre.0 Request processed in 141us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.239524:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868880.239689:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868880.239722:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787868880.239766:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.239804:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03840 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.239868:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617664 00000100:00100000:0.0:1787868880.239872:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617664 00000100:00100000:0.0:1787868880.239903:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787868880.239911:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939617664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868880.240007:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939617664:12345-0@lo:503:mount.lustre.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.240015:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787868880.240512:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939617664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787868880.241423:0:17116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17116:1874715939617792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.241489:0:17116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.241522:0:17116:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.241582:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617792 00000100:00100000:0.0:1787868880.241588:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617792 00000100:00100000:0.0:1787868880.241627:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787868880.241635:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+11:17116:x1874715939617792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868880.242435:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+11:17116:x1874715939617792:12345-0@lo:502:llog_process_th.0 Request processed in 798us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.242444:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787868880.242589:0:17116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17116:1874715939617792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787868880.242619:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.242629:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.242632:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787868880.242639:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daa05e9800 00000020:00000080:2.0:1787868880.242642:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787868880.242651:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.242654:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.242655:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787868880.242665:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.242668:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.242669:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787868880.242673:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93daa05e9800 00000020:00000080:2.0:1787868880.242675:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787868880.242770:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.242783:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.242784:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787868880.242787:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.242790:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.242791:0:17116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787868880.242795:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daa05e9800 00000020:00000080:2.0:1787868880.242797:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787868880.243883:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868880.243892:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.243894:0:17116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787868880.243898:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868880.243901:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868880.243903:0:17116:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787868880.243908:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93daa05e9800 00000020:00000080:2.0:1787868880.243910:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787868880.244053:0:17116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17116:1874715939617920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.244136:0:17116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.244341:0:17116:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.244429:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939617920 00000100:00100000:0.0:1787868880.244443:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939617920 00000100:00100000:0.0:1787868880.244501:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787868880.244512:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+11:17116:x1874715939617920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868880.244691:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+11:17116:x1874715939617920:12345-0@lo:502:llog_process_th.0 Request processed in 180us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.244699:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868880.246893:0:17116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17116:1874715939617920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787868880.246934:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868880.246942:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868880.246945:0:17116:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787868880.246949:0:17116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787868880.247052:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787868880.247075:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868880.247104:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247115:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868880.247323:0:17067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787868880.247327:0:17067:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93daa05e9800 10000000:01000000:0.0:1787868880.247331:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93daa05e9800 10000000:01000000:0.0:1787868880.247335:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868880.247341:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93daa05e9800 from 1 10000000:01000000:0.0:1787868880.247344:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868880.247377:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247386:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247396:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868880.247415:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868880.247484:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868880.247519:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.247541:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618048 00000100:00100000:0.0:1787868880.247546:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618048 00000100:00100000:0.0:1787868880.247585:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787868880.247593:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+11:17067:x1874715939618048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868880.247605:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868880.247619:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287c00/0x2f11f4d3bde2e1fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e1f7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247644:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287c00/0x2f11f4d3bde2e1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1f7 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247654:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287c00/0x2f11f4d3bde2e1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1f7 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868880.247714:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287c00, rc 0) 00000100:00100000:0.0:1787868880.247757:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618048:12345-0@lo:101:mount.lustre.0 Request processed in 163us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.247763:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868880.248269:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868880.248285:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868880.248294:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868880.248354:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868880.248877:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868880.248908:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.249073:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618176 00000100:00100000:0.0:1787868880.249079:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618176 00000100:00100000:0.0:1787868880.249130:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868880.249139:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868880.249367:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618176:12345-0@lo:501:mount.lustre.0 Request processed in 229us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.249375:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787868880.249530:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868880.249569:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787868880.249609:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868880.249639:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868880.250035:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618304 00000100:00100000:0.0:1787868880.250045:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618304 00000100:00100000:0.0:1787868880.250084:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868880.250101:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868880.250297:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618304:12345-0@lo:503:mount.lustre.0 Request processed in 206us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868880.250304:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787868880.250478:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868880.251346:0:17118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787868880.251397:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868880.251432:0:17118:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868880.251483:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618432 00000100:00100000:1.0:1787868880.251489:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618432 00000100:00100000:1.0:1787868880.251524:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787868880.251531:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868880.251641:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618432:12345-0@lo:502:llog_process_th.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868880.251648:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868880.252315:0:17118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618432:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787868880.252388:0:17118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787868880.252405:0:17118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93d9863d1a48) 00000020:00000080:0.0:1787868880.252426:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787868880.252510:0:17118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93daa05e9800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787868880.252515:0:17118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daa05e9800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787868880.252518:0:17118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05e9800 4 00010000:00080000:0.0:1787868880.252550:0:17118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93da88304800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868880.257445:0:17118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787868880.258404:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787868880.258455:0:17118:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787868880.258468:0:17118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f11f4d3bde2e20c 00000100:00080000:2.0:1787868880.258480:0:17118:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787868880.258486:0:17118:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93da88304800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868880.258523:0:17118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a821c0 x1874715939618560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868880.258565:0:17118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787868880.258886:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939618560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787868880.258960:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.259852:0:17118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.259906:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.259942:0:17118:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868880.262146:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618688 00000100:00100000:1.0:1787868880.262177:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618688 00000100:00100000:1.0:1787868880.263217:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787868880.263230:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787868880.263414:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618688:12345-0@lo:502:llog_process_th.0 Request processed in 187us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868880.263423:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787868880.265350:0:17118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.265430:0:17118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.265500:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.265544:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618816 00000100:00100000:2.0:1787868880.265550:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618816 00000100:00100000:2.0:1787868880.265596:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868880.265605:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787868880.265718:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:17118:x1874715939618816:12345-0@lo:502:llog_process_th.0 Request processed in 113us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868880.265727:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868880.265778:0:17118:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868880.265791:0:17118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:431a2c34-804b-46dd-9d1f-913354b6c612:17118:1874715939618816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787868880.265812:0:17118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787868880.269118:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787868880.269181:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787868880.271311:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868880.271330:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787868880.271388:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787868880.271391:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787868880.271392:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868880.271393:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868880.271394:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868880.271399:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868880.271400:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868880.271401:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787868880.271403:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868880.271404:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787868880.271408:0:17067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787868880.271410:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787868880.271412:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787868880.271413:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868880.271414:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868880.271414:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868880.271415:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868880.271416:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868880.271417:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787868880.271418:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868880.271419:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787868880.271445:0:17067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787868880.271465:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787868880.271539:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868880.271569:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8609c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868880.271605:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618944 00000100:00100000:1.0:1787868880.271614:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618944 00000100:00100000:1.0:1787868880.271671:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787868880.271680:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787868880.271708:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787868880.271721:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787868880.272904:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939618560 00000100:00100000:0.0:1787868880.272916:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939618560 00000100:00100000:0.0:1787868880.272948:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868880.272956:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939618560:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787868880.273035:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939618560:12345-0@lo:38:llog_process_th.0 Request processed in 78us (14073us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787868880.273043:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868880.273105:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868880.273115:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88304800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868880.273119:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787868880.273132:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939618560:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1787868880.290564:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787868880.290578:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787868880.290816:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787868880.290821:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787868880.290844:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.290864:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.290883:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.290921:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.290936:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.290951:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939619072:0@lo:104: 00000100:00100000:2.0:1787868880.291018:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868880.291060:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03540 going to sleep for 11 seconds 00000100:00100000:1.0:1787868880.291458:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619072 00000100:00100000:1.0:1787868880.291466:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619072 00000100:00100000:1.0:1787868880.291520:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868880.291530:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939619072:12345-0@lo:104: 00010000:00010000:1.0:1787868880.291544:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868880.291629:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868880.291636:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939619072:12345-0@lo:104: Request processed in 107us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868880.291644:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868880.291679:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939619072:0@lo:104: 00010000:00010000:3.0:1787868880.291699:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868880.291765:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17067:x1874715939618944:12345-0@lo:253:mount.lustre.0 Request processed in 20085us (20225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868880.291774:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787868880.291851:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17067:1874715939618944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787868880.291862:0:17067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787868880.291865:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787868880.291867:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787868880.291868:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868880.291869:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868880.291870:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868880.291872:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868880.291873:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868880.291875:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787868880.291877:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868880.291878:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787868880.291890:0:17067:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787868880.294046:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868880.294058:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.294070:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868880.294074:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.294084:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868880.294101:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868880.294128:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868880.294268:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.294276:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868880.294300:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.294308:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80030600/0x2f11f4d3bde2e1db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1e2 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.294328:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868880.294330:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868880.294332:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868880.294369:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939619200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868880.294428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868880.294619:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619200 00000100:00100000:3.0:1787868880.294626:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619200 00010000:00010000:3.0:1787868880.294653:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868880.294678:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787868880.294686:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+12:3637:x1874715939619200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868880.294698:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868880.294702:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294713:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294726:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e1e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1db expref: 12 pid: 17082 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294739:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294746:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787868880.294774:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003952437s 00010000:00010000:3.0:1787868880.294778:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294785:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294792:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294798:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294803:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868880.294806:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294813:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294835:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868880.294846:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868880.294882:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+11:3637:x1874715939619200:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868880.294889:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868880.295038:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939619200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868880.295063:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.295072:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868880.295078:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030000/0x2f11f4d3bde2e213 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787868880.327666:0:17067:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:1.0:1787868880.330342:0:17128:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000040:01000000:0.0:1787868880.330342:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787868880.330348:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787868880.332753:0:17129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787868880.333055:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787868880.333399:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787868880.335706:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787868880.335746:0:17067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787868880.338369:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787868880.338448:0:17129:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1787868880.340038:0:17067:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787868880.340059:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787868880.340333:0:17067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787868880.340825:0:17130:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93da9393f840 x1874715939619328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868880.340837:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000040:00080000:0.0:1787868880.344665:0:17067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787868880.346891:0:17067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787868880.347424:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787868880.349716:0:17067:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1787868880.354738:0:17067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787868880.356537:0:17067:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787868880.356581:0:17067:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3fe4146b988 00100000:10000000:1.0:1787868880.356589:0:17067:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787868880.357855:0:17067:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787868880.357873:0:17067:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787868880.357894:0:17067:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787868880.357911:0:17067:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787868880.360068:0:17067:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868880.361055:0:17067:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868880.802264:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787868881.249349:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787868881.249359:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05e9800 from 7 10000000:01000000:3.0:1787868881.249365:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787868881.249427:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868881.249439:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868881.249450:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868881.249477:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939619456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868881.249550:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868881.249706:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619456 00000100:00100000:2.0:1787868881.249716:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619456 00000100:00100000:2.0:1787868881.249778:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868881.249790:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+11:17085:x1874715939619456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868881.249805:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868881.249820:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e21a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868881.249844:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868881.249855:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868881.249865:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030600, rc 0) 00000100:00100000:3.0:1787868881.250843:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868881.254918:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17085:x1874715939619456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5119us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868881.254931:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787868881.255136:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939619456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868881.255193:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868881.255209:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868881.255368:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939619584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787868881.255416:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868881.255462:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868881.255924:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619584 00000100:00100000:2.0:1787868881.255932:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619584 00000100:00100000:2.0:1787868881.255998:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868881.256009:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17085:x1874715939619584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787868881.256032:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787868881.256060:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787868881.256063:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787868881.256206:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:17085:x1874715939619584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868881.256214:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787868881.256226:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939619584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787868881.256295:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868881.256305:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868881.256315:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868881.316818:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868881.379366:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787868881.825299:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787868882.338921:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787868882.404073:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787868882.849980:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868883.428603:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787868883.875587:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868884.449267:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787868884.907650:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787868885.281393:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787868885.281399:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787868885.281403:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868885.281411:0:13937:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1787868885.281417:0:13937:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787868885.281424:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93dab7f72800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868885.281449:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a82d00 x1874715939619840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868885.281465:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868885.281469:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787868885.281472:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868885.281475:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787868885.281477:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787868885.281480:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787868885.281482:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93da88304800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868885.281487:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93da88304800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868885.281499:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a82580 x1874715939619968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868885.281604:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868885.281626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939619712:0@lo:400:kworker.0 00000100:00100000:2.0:1787868885.281696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868885.281759:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619712 00000100:00100000:2.0:1787868885.281766:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619712 00000100:00100000:2.0:1787868885.281809:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868885.281819:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:3639:x1874715939619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868885.281869:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:3639:x1874715939619712:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868885.281876:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787868885.282026:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939619840:0@lo:38:kworker.0 00000100:00100000:0.0:1787868885.282106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868885.282133:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939619968:0@lo:38:kworker.0 00000100:00100000:0.0:1787868885.282196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868885.282235:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619840 00000100:00100000:0.0:1787868885.282240:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619840 00000100:00100000:0.0:1787868885.282260:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868885.282265:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939619840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787868885.282280:0:17094:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787868885.283343:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939619712:0@lo:400:kworker.0 00000100:00100000:1.0:1787868885.291276:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619968 00000100:00100000:1.0:1787868885.291301:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619968 00000100:00100000:1.0:1787868885.291348:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868885.291357:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939619968:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787868885.291387:0:17090:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1787868885.291425:0:17090:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f11f4d3bde2e228 00000004:00100000:1.0:1787868885.291442:0:17090:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787868885.291574:0:17090:0:(import.c:65:import_set_state_nolock()) ffff93dab5b26000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868885.291671:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874715939619968:12345-0@lo:38:kworker.0 Request processed in 314us (9474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868885.291679:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787868885.301592:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d988a82580 x1874715939619968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868885.301614:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787868885.301624:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787868885.301629:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787868885.301645:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88304800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787868885.301652:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939619968:0@lo:38:kworker.0 00000100:00100000:0.0:1787868885.301754:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939619840:12345-0@lo:38:kworker.0 Request processed in 19487us (19647us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787868885.301765:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787868885.305461:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868885.305475:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868885.305480:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939619840:0@lo:38:kworker.0 00000100:00100000:0.0:1787868885.473322:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000001:02000400:2.0:1787868885.593557:0:17373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787868885.921588:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868886.497369:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000020:00000004:2.0:1787868886.606438:0:17425:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868886.606826:0:17425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868886.948267:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868887.530912:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000020:00000004:1.0:1787868887.683509:0:17475:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868887.683707:0:17475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868887.978334:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868888.558020:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868888.994281:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868889.571380:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787868890.017310:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868890.401266:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868880/real 1787868880] req@ffff93d988a830c0 x1874715939616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868890.401298:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a830c0 x1874715939616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868890.401309:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868880/real 1787868880] req@ffff93da9393c780 x1874715939616768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868890.401321:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da9393c780 x1874715939616768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868890.401341:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868890.401359:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868890.401363:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787868890.401369:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868890.401374:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868890.401377:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939616768:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787868890.401529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787868890.401533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787868890.401536:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868890.401541:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:2.0:1787868890.401547:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787868890.401554:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93dab7f72800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868890.401575:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a81e00 x1874715939620224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868890.401587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868890.401589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787868890.401591:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868890.401593:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1787868890.401605:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787868890.401608:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93dab7ed8000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868890.401620:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a80b40 x1874715939620352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868890.401629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868890.401631:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787868890.401633:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868890.401636:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1787868890.401638:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787868890.401641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868890.401649:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a80000 x1874715939620480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868890.401693:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939620608:0@lo:400:kworker.0 00000100:00100000:2.0:1787868890.401773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868890.401891:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868890.401914:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939620096:0@lo:400:kworker.0 00000100:00100000:1.0:1787868890.401952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868890.402132:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620608 00000100:00100000:0.0:1787868890.402139:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620608 00000100:00100000:0.0:1787868890.402212:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868890.402222:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939620608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868890.402277:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939620608:12345-0@lo:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868890.402285:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787868890.402327:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d988a80780 x1874715939620608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868890.402339:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939620608:0@lo:400:kworker.0 00000100:00100000:0.0:1787868890.402362:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620224:0@lo:38:kworker.0 00000100:00100000:0.0:1787868890.402414:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868890.402431:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620352:0@lo:8:kworker.0 00000400:00000100:0.0:1787868890.402451:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939620352 offset 0 length 520: 4 00000100:00100000:0.0:1787868890.402462:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620480:0@lo:8:kworker.0 00000400:00000100:0.0:1787868890.402494:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939620480 offset 0 length 520: 4 00000100:00100000:2.0:1787868890.402841:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620096 00000100:00100000:2.0:1787868890.402846:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620096 00000100:00100000:2.0:1787868890.402888:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868890.402910:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:3638:x1874715939620096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868890.402959:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+12:3638:x1874715939620096:12345-0@lo:400:kworker.0 Request processed in 64us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868890.402965:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868890.403008:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620224 00000100:00100000:2.0:1787868890.403012:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620224 00000100:00100000:2.0:1787868890.403028:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868890.403033:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939620224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787868890.403047:0:17093:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868890.406150:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939620096:0@lo:400:kworker.0 00000100:00100000:3.0:1787868890.427397:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939620224:12345-0@lo:38:kworker.0 Request processed in 24354us (24973us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787868890.427414:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787868890.427528:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868890.427534:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787868890.427537:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620224:0@lo:38:kworker.0 00000100:00100000:1.0:1787868890.595857:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868891.042119:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868891.617479:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868892.068096:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868892.578047:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787868892.651106:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868893.089323:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868893.672235:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868894.113305:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868894.689305:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868895.138461:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868895.487736:0:17821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787868895.487743:0:17821:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787868895.487745:0:17821:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787868895.488042:0:17821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93dab7ec9800 00000020:01000004:3.0:1787868895.488060:0:17821:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787868895.488071:0:17821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787868895.488086:0:17821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93dabd84b490) 00000020:00000080:3.0:1787868895.488106:0:17821:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00080000:3.0:1787868895.521846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787868895.521856:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787868895.521859:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868895.521877:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1787868895.521883:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787868895.521897:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93dab7f72800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868895.521931:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988190f00 x1874715939620864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868895.521944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868895.521962:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787868895.521965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868895.521967:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868895.522183:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939620992:0@lo:400:kworker.0 00000100:00100000:1.0:1787868895.522281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.522411:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620992 00000100:00100000:3.0:1787868895.522420:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620992 00000100:00100000:3.0:1787868895.522476:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868895.522486:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939620992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868895.522547:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939620992:12345-0@lo:400:kworker.0 Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.522554:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787868895.523119:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620864:0@lo:38:kworker.0 00000100:00100000:0.0:1787868895.523174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.523232:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868895.523243:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939620736:0@lo:400:kworker.0 00000100:00100000:0.0:1787868895.523291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.523330:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620864 00000100:00100000:0.0:1787868895.523334:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620864 00000100:00100000:0.0:1787868895.523361:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787868895.523368:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939620864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787868895.523388:0:17094:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787868895.524235:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939620736 00000100:00100000:3.0:1787868895.524244:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939620736 00000100:00100000:3.0:1787868895.524297:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787868895.524305:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:3636:x1874715939620736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868895.524393:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:3636:x1874715939620736:12345-0@lo:400:kworker.0 Request processed in 88us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.524400:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787868895.528006:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d988191680 x1874715939620992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868895.528031:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988191680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939620992:0@lo:400:kworker.0 00000100:00100000:1.0:1787868895.533384:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939620736:0@lo:400:kworker.0 00000100:00100000:1.0:1787868895.547177:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939620864:12345-0@lo:38:kworker.0 Request processed in 23779us (23972us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868895.547202:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787868895.547445:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868895.547453:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787868895.547459:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620864:0@lo:38:kworker.0 00100000:10000000:2.0:1787868895.583024:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.584083:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787868895.586564:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.586865:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.590671:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.591034:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.591577:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.591754:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.591996:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.592217:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.593065:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.594004:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.594466:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.594709:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.595072:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.596031:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.596508:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.596987:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.597324:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.598299:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.598576:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.599047:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.599862:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787868895.600186:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787868895.601100:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787868895.603526:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.603765:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.604454:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787868895.604735:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787868895.605570:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.605810:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787868895.606592:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.607525:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.607814:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787868895.610580:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787868895.611044:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.611263:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787868895.611515:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.611805:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787868895.612111:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787868895.612503:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.612726:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.613020:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.613249:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787868895.613710:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787868895.614046:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1787868895.615594:0:17821:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787868895.615856:0:17821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787868895.615868:0:17821:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787868895.615910:0:17821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e236 00000020:01000004:2.0:1787868895.615920:0:17821:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787868895.615945:0:17821:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787868895.615949:0:17821:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787868895.615956:0:17821:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787868895.615987:0:17821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787868895.615992:0:17821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787868895.621413:0:17821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787868895.621458:0:17821:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787868895.621463:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787868895.621464:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787868895.621466:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868895.621467:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868895.621468:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868895.621470:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868895.621471:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868895.621473:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868895.621474:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868895.621478:0:17821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787868895.621480:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787868895.621481:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787868895.621482:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868895.621483:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868895.621489:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868895.621490:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868895.621491:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868895.621492:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868895.621493:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868895.621522:0:17821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787868895.621543:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787868895.621650:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.621764:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18bacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.622026:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621120 00000100:00100000:0.0:1787868895.622035:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621120 00000100:00100000:0.0:1787868895.622130:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868895.622141:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17821:x1874715939621120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787868895.622203:0:17083:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787868895.622206:0:17083:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787868895.622215:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787868895.622755:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17821:x1874715939621120:12345-0@lo:253:mount.lustre.0 Request processed in 615us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.622764:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787868895.623004:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787868895.623019:0:17821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787868895.623022:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787868895.623023:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787868895.623025:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868895.623026:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868895.623027:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868895.623028:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868895.623029:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787868895.623031:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868895.623032:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787868895.623054:0:17821:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dab7ec9800 from lustre-MDT0001 10000000:01000000:1.0:1787868895.623080:0:17821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787868895.623083:0:17821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787868895.623090:0:17821:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd849a48 local copy 00010000:00010000:1.0:1787868895.623100:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.623282:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868895.623318:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.623476:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.623539:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621248 00000100:00100000:0.0:1787868895.623545:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621248 00000100:00100000:0.0:1787868895.623621:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868895.623630:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17821:x1874715939621248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868895.623698:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+12:17821:x1874715939621248:12345-0@lo:501:mount.lustre.0 Request processed in 70us (379us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787868895.623713:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787868895.623782:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621248:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787868895.623806:0:17821:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787868895.623831:0:17821:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787868895.623838:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.623848:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.623875:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93dab7ec9800 10000000:01000000:1.0:1787868895.623880:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787868895.623886:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93dabd849a48 10000000:01000000:1.0:1787868895.623888:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787868895.623906:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93dabd849a48 from 1 10000000:01000000:1.0:1787868895.623910:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787868895.623936:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.623944:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.623953:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.623967:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868895.623993:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.624298:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868895.624515:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621376 00000100:00100000:3.0:1787868895.624520:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621376 00000100:00100000:3.0:1787868895.624545:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868895.624554:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+12:17821:x1874715939621376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868895.624563:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868895.624577:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828c400/0x2f11f4d3bde2e244 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e23d expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.624599:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828c400/0x2f11f4d3bde2e244 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e23d expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.624609:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828c400/0x2f11f4d3bde2e244 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e23d expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.624626:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c400, rc 0) 00000100:00100000:3.0:1787868895.624705:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+13:17821:x1874715939621376:12345-0@lo:101:mount.lustre.0 Request processed in 152us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.624711:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787868895.624885:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868895.625012:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625022:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.625047:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787868895.625064:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625072:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.625080:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93dab7ec9800 10000000:01000000:1.0:1787868895.625084:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787868895.625088:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93dab7ec9800 from 1 10000000:01000000:1.0:1787868895.625090:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787868895.625108:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625115:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625122:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.625136:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868895.625199:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.625223:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.625275:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621504 00000100:00100000:0.0:1787868895.625280:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621504 00000100:00100000:0.0:1787868895.625313:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787868895.625320:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+13:17821:x1874715939621504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.625328:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868895.625407:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286a00/0x2f11f4d3bde2e252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e24b expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.625424:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286a00/0x2f11f4d3bde2e252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e24b expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.625432:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286a00/0x2f11f4d3bde2e252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e24b expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.625440:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:0.0:1787868895.625475:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+14:17821:x1874715939621504:12345-0@lo:101:mount.lustre.0 Request processed in 156us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.625481:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868895.625554:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868895.625564:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625572:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.625592:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787868895.625596:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625603:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.625609:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787868895.625612:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787868895.625617:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93dab7ec9800 10000000:01000000:1.0:1787868895.625619:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787868895.625622:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787868895.625624:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787868895.625636:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625643:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.625650:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.625662:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868895.625689:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.625752:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03180 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.626071:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621632 00000100:00100000:2.0:1787868895.626076:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621632 00000100:00100000:0.0:1787868895.626124:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787868895.626133:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+14:17821:x1874715939621632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.626140:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868895.626148:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2e260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e259 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.626228:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2e260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e259 expref: 15 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.626251:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2e260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e259 expref: 15 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.626257:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787868895.626341:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939621632:12345-0@lo:101:mount.lustre.0 Request processed in 201us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.626348:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868895.626597:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868895.626608:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.626623:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868895.629314:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787868895.630141:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868895.634725:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787868895.634793:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787868895.634821:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787868895.634836:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787868895.634849:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787868895.634863:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787868895.634876:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787868895.635010:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787868895.635034:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787868895.635049:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787868895.635060:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787868895.635072:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787868895.635087:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787868895.635105:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787868895.635119:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787868895.635132:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787868895.635145:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787868895.635251:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787868895.635269:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787868895.635282:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787868895.635296:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787868895.635309:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787868895.635321:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787868895.635428:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787868895.635436:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787868895.635571:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868895.635664:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.635767:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.635825:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621760 00000100:00100000:0.0:1787868895.635832:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621760 00000100:00100000:0.0:1787868895.635885:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787868895.636071:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939621760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868895.636504:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939621760:12345-0@lo:501:mount.lustre.0 Request processed in 609us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.636514:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868895.636593:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868895.636631:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787868895.636678:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.636738:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.636767:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939621888 00000100:00100000:0.0:1787868895.636772:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939621888 00000100:00100000:0.0:1787868895.636844:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787868895.636852:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939621888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868895.637637:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939621888:12345-0@lo:503:mount.lustre.0 Request processed in 782us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.637646:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868895.637734:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939621888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787868895.638280:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868895.638379:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868895.638431:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.638866:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.639009:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622016 00000100:00100000:2.0:1787868895.639016:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622016 00000100:00100000:2.0:1787868895.639058:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787868895.639066:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939622016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.639772:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939622016:12345-0@lo:502:mount.lustre.0 Request processed in 703us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.639781:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868895.639880:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868895.640201:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787868895.640228:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787868895.640240:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787868895.640252:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787868895.640263:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787868895.640274:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787868895.640284:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787868895.640294:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787868895.640305:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787868895.640315:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787868895.640326:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787868895.640347:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787868895.640359:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787868895.640370:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787868895.640380:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787868895.640400:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787868895.640410:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787868895.640421:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787868895.640433:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787868895.640443:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787868895.640454:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787868895.640465:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787868895.640475:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787868895.640486:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787868895.640496:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787868895.640507:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787868895.640517:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787868895.640528:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787868895.640540:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787868895.640551:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787868895.640563:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787868895.640575:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787868895.640587:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787868895.640599:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787868895.640611:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787868895.640624:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787868895.640637:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787868895.640650:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787868895.640661:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787868895.640672:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787868895.640682:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787868895.640695:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787868895.640708:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787868895.640720:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787868895.640755:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868895.640824:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.640854:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.641103:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622144 00000100:00100000:2.0:1787868895.641111:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622144 00000100:00100000:2.0:1787868895.641150:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787868895.641190:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939622144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.641293:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939622144:12345-0@lo:502:mount.lustre.0 Request processed in 107us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.641301:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868895.641470:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868895.641521:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1787868895.641531:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787868895.642726:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868895.642739:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868895.642741:0:17825:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787868895.642747:0:17825:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787868895.642750:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868895.642765:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93dabd2f8000) 00000020:00000080:2.0:1787868895.642807:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787868895.642816:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787868895.643010:0:17825:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787868895.643019:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e26e 00000020:00000080:3.0:1787868895.643551:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787868895.643558:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.643563:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.643564:0:17825:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787868895.643569:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.643573:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.643574:0:17825:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787868895.643578:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868895.643589:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93dabd848000) 00000020:00000080:3.0:1787868895.643604:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787868895.643609:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787868895.643611:0:17825:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787868895.643615:0:17825:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787868895.643623:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787868895.643689:0:17825:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab7ec9800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787868895.643703:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93daaf714ed8) 00000020:00000080:3.0:1787868895.643711:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787868895.643782:0:17825:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787868895.643788:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e283 00000020:00000080:3.0:1787868895.644007:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787868895.644017:0:17825:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787868895.644022:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2f11f4d3bde2e28a 00080000:01000000:3.0:1787868895.644031:0:17825:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787868895.644034:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e291 00000100:00100000:3.0:1787868895.713280:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787868895.747192:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1787868895.748202:0:17825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1787868895.749029:0:17825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787868895.750806:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787868895.750820:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868895.750834:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868895.750837:0:17825:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787868895.750842:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868895.750848:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868895.750849:0:17825:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787868895.750853:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787868895.750859:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:0.0:1787868895.750902:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787868895.750916:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93d9863d0000) 00000020:00000080:0.0:1787868895.750937:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787868895.750943:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787868895.751024:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787868895.751031:0:17825:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787868895.751037:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e29f 00010000:00080000:0.0:1787868895.751067:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93da88346800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787868895.756313:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787868895.763775:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787868895.763821:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787868895.763878:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787868895.763908:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e2a6 00000100:00080000:3.0:1787868895.763918:0:17825:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868895.763925:0:17825:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93da88346800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868895.763981:0:17825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988190b40 x1874715939622272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868895.764023:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787868895.764064:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787868895.764196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787868895.766418:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.766427:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766429:0:17825:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787868895.766432:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787868895.766435:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787868895.766437:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787868895.766438:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787868895.766440:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787868895.766442:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766444:0:17825:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787868895.766446:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.766450:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766462:0:17825:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787868895.766466:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787868895.766521:0:17825:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787868895.766535:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.766539:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766540:0:17825:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787868895.766543:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787868895.766545:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787868895.766546:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787868895.766548:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787868895.766549:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787868895.766551:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766564:0:17825:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787868895.766567:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787868895.766570:0:17825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787868895.766573:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.766574:0:17825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787868895.766577:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787868895.766580:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1787868895.766604:0:17825:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787868895.766606:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787868895.766620:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93daaf713490) 00000020:00000080:3.0:1787868895.766637:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787868895.766642:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787868895.766709:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787868895.766715:0:17825:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787868895.766721:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e2b4 00010000:00080000:3.0:1787868895.766753:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab6e72000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00000100:00080000:1.0:1787868895.766775:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.766782:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868895.766785:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.766787:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868895.766829:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622272 00000100:00100000:1.0:1787868895.766839:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622272 00000100:00100000:1.0:1787868895.766880:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868895.766902:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939622272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787868895.766935:0:17093:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1787868895.766975:0:17093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e2bb 00000004:00100000:1.0:1787868895.766993:0:17093:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787868895.767000:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787868895.767016:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1787868895.771845:0:17825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787868895.772189:0:17825:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787868895.775088:0:17825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868895.775820:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787868895.776091:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1787868895.778131:0:17830:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787868895.778139:0:17830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787868895.780215:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787868895.780230:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787868895.780278:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787868895.780302:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e2c2 00000100:00080000:1.0:1787868895.780316:0:17825:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868895.780322:0:17825:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab6e72000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868895.780366:0:17825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9393e580 x1874715939622400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787868895.780399:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787868895.780426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.780431:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868895.780434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.780437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787868895.780492:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868895.780496:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868895.780499:0:17825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787868895.780502:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787868895.780505:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787868895.780506:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868895.780508:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787868895.780509:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787868895.780512:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868895.780513:0:17825:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787868895.780515:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787868895.780519:0:17825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787868895.780522:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868895.780523:0:17825:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787868895.780526:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787868895.780529:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787868895.780569:0:17825:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787868895.780572:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787868895.780584:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93d986e4ced8) 00000020:00000080:1.0:1787868895.780596:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787868895.780600:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787868895.780660:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787868895.780668:0:17825:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787868895.780681:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2e2d0 00010000:00080000:1.0:1787868895.780713:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab7ecf800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868895.780945:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787868895.781022:0:17825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787868895.781038:0:17825:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787868895.781476:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622400:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787868895.781548:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939622400 offset 0 length 520: 4 00000040:00080000:1.0:1787868895.784061:0:17825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868895.784342:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787868895.784470:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787868895.784887:0:17832:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787868895.784903:0:17832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787868895.785726:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787868895.785743:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787868895.785785:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787868895.785822:0:17825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e2d7 00000100:00080000:3.0:1787868895.785836:0:17825:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868895.785843:0:17825:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868895.785882:0:17825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9881921c0 x1874715939622528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868895.785976:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787868895.786035:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.786040:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.786042:0:17825:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787868895.786044:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.786049:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.786050:0:17825:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787868895.786053:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787868895.786054:0:17825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787868895.786056:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.786059:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.786060:0:17825:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787868895.786062:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.786064:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.786065:0:17825:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787868895.786068:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787868895.786099:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.786101:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.786102:0:17825:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787868895.786105:0:17825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1787868895.786610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.786615:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868895.786618:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.786620:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787868895.786645:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787868895.786678:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787868895.786703:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.786718:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.786727:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab7ec9800 from 1 10000000:01000000:1.0:1787868895.786730:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787868895.786773:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.786782:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.786808:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.786841:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868895.786998:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622528:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787868895.787040:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939622528 offset 0 length 520: 4 00000100:00100000:1.0:1787868895.787152:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.787203:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.787313:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622656 00000100:00100000:0.0:1787868895.787321:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622656 00000100:00100000:0.0:1787868895.787460:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787868895.787471:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+15:17821:x1874715939622656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.787487:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868895.787502:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e2de expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.787780:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 16 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.787806:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 16 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.787817:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868895.787878:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+16:17821:x1874715939622656:12345-0@lo:101:mount.lustre.0 Request processed in 409us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.787886:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868895.788086:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868895.788104:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.788114:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.788877:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622784:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787868895.789040:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.789073:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.789128:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622784 00000100:00100000:0.0:1787868895.789134:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622784 00000100:00100000:0.0:1787868895.789195:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787868895.789202:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+16:17821:x1874715939622784:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787868895.789218:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787868895.789234:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787868895.789238:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787868895.789316:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+16:17821:x1874715939622784:12345-0@lo:256:mount.lustre.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.789324:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868895.789969:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622784:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787868895.790743:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787868895.790824:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.790837:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.790846:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab7ec9800 from 1 10000000:01000000:1.0:1787868895.790849:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868895.790882:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.790942:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.790953:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868895.790974:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868895.791032:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.791073:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.791205:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939622912 00000100:00100000:0.0:1787868895.791212:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939622912 00000100:00100000:0.0:1787868895.791255:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787868895.791264:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+16:17821:x1874715939622912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.791275:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868895.791289:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e2ec expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.791324:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.791345:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.791355:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287e00, rc 0) 00000100:00100000:0.0:1787868895.791393:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939622912:12345-0@lo:101:mount.lustre.0 Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.791400:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787868895.791675:0:17093:0:(import.c:65:import_set_state_nolock()) ffff93dab6e76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868895.791737:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939622272:12345-0@lo:38:llog_process_th.0 Request processed in 24849us (27542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.791747:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787868895.791909:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868895.791918:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787868895.791926:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787868895.791932:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787868895.791935:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787868895.791951:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787868895.792079:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939622912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868895.792096:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.792107:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868895.792275:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868895.792309:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868895.792352:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.792375:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.792560:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623040 00000100:00100000:0.0:1787868895.792565:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623040 00000100:00100000:0.0:1787868895.792594:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868895.792601:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868895.792689:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623040:12345-0@lo:501:mount.lustre.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.792697:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868895.792734:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868895.792762:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868895.792822:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.792835:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.792846:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623296 00000100:00100000:0.0:1787868895.792849:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623296 00000100:00100000:0.0:1787868895.792868:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868895.792873:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868895.792968:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623296:12345-0@lo:503:mount.lustre.0 Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.792975:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787868895.793013:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787868895.793413:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787868895.793482:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868895.793518:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.793533:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.793546:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623424 00000100:00100000:0.0:1787868895.793549:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623424 00000100:00100000:0.0:1787868895.793569:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868895.793575:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868895.793664:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623424:12345-0@lo:502:mount.lustre.0 Request processed in 88us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.793671:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868895.793710:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787868895.793931:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787868895.793955:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1787868895.793970:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1787868895.793983:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1787868895.794006:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1787868895.794020:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1787868895.794032:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1787868895.794061:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1787868895.794076:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787868895.794087:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1787868895.794100:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1787868895.794119:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868895.794151:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.794196:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623552 00000100:00100000:0.0:1787868895.794200:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623552 00000100:00100000:0.0:1787868895.794222:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868895.794228:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868895.794290:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623552:12345-0@lo:502:mount.lustre.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.794296:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868895.794323:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.794334:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787868895.794365:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1787868895.794372:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1787868895.795045:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939623168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868895.795095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787868895.795469:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.795479:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795481:0:17834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787868895.795489:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab7ec9800 00000020:00000080:3.0:1787868895.795492:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868895.795499:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.795502:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795512:0:17834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787868895.795516:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.795519:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795520:0:17834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787868895.795524:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab7ec9800 00000020:00000080:3.0:1787868895.795526:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868895.795596:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.795600:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795602:0:17834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787868895.795604:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.795607:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795608:0:17834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868895.795612:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab7ec9800 00000020:00000080:3.0:1787868895.795614:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868895.795633:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.795636:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795637:0:17834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868895.795639:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868895.795642:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795643:0:17834:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787868895.795646:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab7ec9800 00000020:00000080:3.0:1787868895.795649:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868895.795671:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868895.795674:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868895.795676:0:17834:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787868895.795679:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000100:00100000:0.0:1787868895.800171:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623168 00000100:00100000:0.0:1787868895.800191:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623168 00000100:00100000:0.0:1787868895.800287:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868895.800300:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939623168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868895.801612:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787868895.801774:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939623168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1474us (6675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.801786:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787868895.802505:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939623168:0@lo:41:osp-pre-0-1.0 00000020:01000000:0.0:1787868895.803863:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787868895.803999:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868895.804440:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.804461:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868895.804531:0:17821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787868895.804536:0:17821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93dab7ec9800 10000000:01000000:0.0:1787868895.804551:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93dab7ec9800 10000000:01000000:0.0:1787868895.804557:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868895.804565:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab7ec9800 from 1 10000000:01000000:0.0:1787868895.804568:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868895.804608:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.804617:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.804627:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868895.804648:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868895.804717:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.804758:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623680 00000100:00100000:0.0:1787868895.804764:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623680 00000100:00100000:0.0:1787868895.804816:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868895.804825:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17821:x1874715939623680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.804840:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868895.804860:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2e301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e2fa expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.804885:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2e301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2fa expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.805025:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2e301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2fa expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.805035:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286400, rc 0) 00000100:00100000:0.0:1787868895.805077:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939623680:12345-0@lo:101:mount.lustre.0 Request processed in 252us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.805084:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868895.805134:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.805169:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868895.805183:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868895.805192:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868895.806634:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787868895.806976:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868895.812460:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787868895.812691:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1787868895.812732:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1787868895.812745:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1787868895.812757:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1787868895.812768:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1787868895.812779:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1787868895.812818:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1787868895.812832:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1787868895.812843:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1787868895.812855:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1787868895.812874:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1787868895.812945:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1787868895.812966:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1787868895.812982:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1787868895.812994:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1787868895.813008:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1787868895.813020:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1787868895.813045:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1787868895.813060:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1787868895.813072:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1787868895.813085:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1787868895.813097:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1787868895.813108:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1787868895.813120:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1787868895.813130:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1787868895.813142:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1787868895.813181:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1787868895.813210:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1787868895.813217:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787868895.814638:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868895.814726:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868895.814827:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986c0b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.822048:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623808 00000100:00100000:2.0:1787868895.822071:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623808 00000100:00100000:2.0:1787868895.822215:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868895.822229:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939623808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868895.822467:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939623808:12345-0@lo:501:mount.lustre.0 Request processed in 242us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.822475:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868895.829669:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868895.829740:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787868895.829822:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868895.829868:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83258780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868895.831042:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939623936 00000100:00100000:0.0:1787868895.831052:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939623936 00000100:00100000:0.0:1787868895.831102:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787868895.831110:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939623936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868895.831251:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939623936:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868895.831266:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787868895.831426:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939623936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787868895.832862:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787868895.832967:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.833033:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868895.833083:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83258780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868895.833244:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624064 00000100:00100000:3.0:1787868895.833251:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624064 00000100:00100000:3.0:1787868895.833534:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787868895.833552:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868895.833659:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624064:12345-0@lo:502:mount.lustre.0 Request processed in 109us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.833675:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787868895.833856:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787868895.834761:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787868895.834803:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787868895.834818:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787868895.834829:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787868895.834848:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787868895.834858:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787868895.834869:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787868895.834879:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787868895.835107:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787868895.835125:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787868895.835136:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787868895.835147:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787868895.835184:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787868895.835198:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787868895.835208:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787868895.835231:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787868895.835242:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787868895.835254:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787868895.835267:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787868895.835278:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787868895.835288:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787868895.835299:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787868895.835309:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787868895.835320:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787868895.835400:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787868895.835416:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787868895.835426:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787868895.835438:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787868895.835451:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787868895.835464:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787868895.835476:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787868895.835502:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787868895.835517:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787868895.835530:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1787868895.836630:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1787868895.836657:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1787868895.836673:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1787868895.836687:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1787868895.836702:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1787868895.836717:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1787868895.836730:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1787868895.836743:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1787868895.836754:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1787868895.836767:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1787868895.836780:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1787868895.836804:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1787868895.836819:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1787868895.836847:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1787868895.837020:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868895.837096:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.837147:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.837237:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624192 00000100:00100000:2.0:1787868895.837245:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624192 00000100:00100000:2.0:1787868895.837297:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787868895.837313:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.837452:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624192:12345-0@lo:502:mount.lustre.0 Request processed in 141us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.837461:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787868895.837520:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787868895.837702:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787868895.837725:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787868895.837749:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.837785:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868895.837819:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83258cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.837836:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624320 00000100:00100000:2.0:1787868895.837840:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624320 00000100:00100000:2.0:1787868895.837865:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787868895.837872:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868895.838118:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624320:12345-0@lo:502:mount.lustre.0 Request processed in 245us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.838124:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787868895.838182:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787868895.838215:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787868895.838221:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787868895.842112:0:17839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787868895.842131:0:17839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93daaf711a48) 00000020:00000080:3.0:1787868895.842171:0:17839:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787868895.842273:0:17839:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab7ec9800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787868895.842277:0:17839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab7ec9800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787868895.842280:0:17839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab7ec9800 3 00010000:00080000:3.0:1787868895.842311:0:17839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d986fa0000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868895.845673:0:17839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787868895.846993:0:17839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787868895.847045:0:17839:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787868895.847058:0:17839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2f11f4d3bde2e30f 00000100:00080000:3.0:1787868895.847070:0:17839:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868895.847082:0:17839:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d986fa0000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868895.847119:0:17839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988192580 x1874715939624448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868895.847151:0:17839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787868895.848004:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939624448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787868895.848074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868895.848166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.848180:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868895.848183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868895.848186:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787868895.848374:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624448 00000100:00100000:3.0:1787868895.848381:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624448 00000100:00100000:3.0:1787868895.848424:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868895.848503:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939624448:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787868895.848531:0:17090:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1787868895.848580:0:17090:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f11f4d3bde2e316 00000004:00100000:3.0:1787868895.848597:0:17090:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787868895.848630:0:17090:0:(import.c:65:import_set_state_nolock()) ffff93dab6e76000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868895.848695:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874715939624448:12345-0@lo:38:llog_process_th.0 Request processed in 193us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.848703:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787868895.848839:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d988192580 x1874715939624448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868895.848851:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868895.848858:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787868895.848866:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787868895.848871:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787868895.848873:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787868895.848880:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939624448:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787868895.849866:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787868895.851269:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787868895.851312:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787868895.851331:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.851344:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787868895.851397:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787868895.851399:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868895.851400:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868895.851401:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868895.851406:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868895.851408:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868895.851409:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868895.851411:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868895.851412:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787868895.851416:0:17821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787868895.851418:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787868895.851419:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868895.851420:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868895.851421:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868895.851422:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868895.851423:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868895.851424:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868895.851425:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868895.851425:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787868895.851999:0:17821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787868895.852024:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787868895.852100:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.852151:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787868895.852192:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624576 00000100:00100000:1.0:1787868895.852201:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624576 00000100:00100000:1.0:1787868895.852255:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868895.852265:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787868895.852293:0:17083:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787868895.852307:0:17083:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787868895.853322:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787868895.853431:0:17083:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787868895.853447:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787868895.853514:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787868895.853519:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787868895.853543:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853562:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 18 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853583:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853591:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853627:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853656:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868895.853672:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939624704:0@lo:104: 00000100:00100000:3.0:1787868895.853706:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.853718:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17821:x1874715939624576:12345-0@lo:253:mount.lustre.0 Request processed in 1455us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868895.853727:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787868895.853743:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.853750:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868895.853758:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939624832:0@lo:104: 00000100:00100000:3.0:1787868895.853778:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.853806:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868895.853824:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624704 00000100:00100000:3.0:1787868895.853830:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624704 00000100:00100000:3.0:1787868895.853855:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624832 00000100:00100000:3.0:1787868895.853857:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624832 00000100:00100000:3.0:1787868895.853867:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868895.853874:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939624704:12345-0@lo:104: 00010000:00010000:3.0:1787868895.853886:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854006:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787868895.854011:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939624704:12345-0@lo:104: Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.854017:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868895.854030:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868895.854041:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939624832:12345-0@lo:104: 00010000:00010000:3.0:1787868895.854048:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854077:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787868895.854081:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939624832:12345-0@lo:104: Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.854087:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787868895.854106:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868895.854112:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854119:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868895.854123:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854131:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868895.854139:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868895.854144:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787868895.854184:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854191:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868895.854196:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868895.854213:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854231:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e2de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2e5 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.854244:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868895.854246:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868895.854247:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868895.854259:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939624960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868895.854286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.854421:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939624960 00000100:00100000:3.0:1787868895.854425:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939624960 00010000:00010000:1.0:1787868895.854704:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868895.854716:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.854724:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868895.854726:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.854733:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868895.854739:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868895.854743:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868895.854761:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.854767:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868895.854778:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.854785:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828c800/0x2f11f4d3bde2e21a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e221 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868895.854813:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868895.854815:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868895.854817:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868895.854823:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868895.854825:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868895.855144:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868895.855209:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868895.855218:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+18:3636:x1874715939624960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868895.855231:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868895.855237:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.855249:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 18 pid: 17082 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.855268:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868895.855312:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+18:3636:x1874715939624960:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.855320:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868895.855368:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939624960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868895.855395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868895.855403:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939625088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868895.855442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868895.855485:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e2e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2de expref: 17 pid: 17082 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868895.855489:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625088 00000100:00100000:3.0:1787868895.855495:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881930c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939624704:0@lo:104: 00000100:00100000:2.0:1787868895.855495:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625088 00000100:00100000:3.0:1787868895.855505:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939624832:0@lo:104: 00010000:00010000:2.0:1787868895.855511:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868895.855521:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868895.855567:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:17821:1874715939624576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787868895.855580:0:17821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787868895.855584:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787868895.855586:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787868895.855587:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868895.855588:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868895.855590:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868895.855591:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868895.855592:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787868895.855595:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868895.855596:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787868895.855607:0:17821:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787868895.856664:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868895.856687:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+17:3636:x1874715939625088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868895.856705:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868895.856713:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856728:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856745:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e21a expref: 17 pid: 17083 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856761:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856770:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787868895.856786:0:17075:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003952437s 00010000:00010000:2.0:1787868895.856801:0:17075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856810:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856817:0:17075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856825:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856832:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828da00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868895.856842:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856851:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856874:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.856885:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868895.856942:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+16:3636:x1874715939625088:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.856950:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868895.858997:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939625088:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868895.859044:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.859057:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868895.859065:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828da00/0x2f11f4d3bde2e31d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1787868895.867487:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787868895.867807:0:17847:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787868895.867967:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1787868895.868736:0:17847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787868895.870444:0:17846:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787868895.870451:0:17846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787868895.872084:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1787868895.872449:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.872520:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787868895.872637:0:17847:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787868895.872783:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdbd80 going to sleep for 11 seconds 00000040:01000000:0.0:1787868895.872890:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787868895.872933:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787868895.873768:0:17821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787868895.873779:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787868895.873844:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868895.875238:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625216 00000100:00100000:1.0:1787868895.875251:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625216 00000100:00100000:1.0:1787868895.875302:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868895.875311:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625216:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.875526:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 215us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868895.875533:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868895.875653:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625216:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787868895.875695:0:17848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787868895.875735:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.875772:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.875808:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42cc0 going to sleep for 11 seconds 00000040:00080000:0.0:1787868895.875995:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787868895.876522:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625344 00000100:00100000:3.0:1787868895.876528:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625344 00000100:00100000:3.0:1787868895.876564:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787868895.876573:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787868895.876699:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868895.876720:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868895.876834:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.876931:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17848:1874715939625472:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.876961:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868895.877029:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42780 going to sleep for 11 seconds 00000100:00100000:2.0:1787868895.877088:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625472 00000100:00100000:2.0:1787868895.877093:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625472 00000100:00100000:2.0:1787868895.877123:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868895.877129:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1874715939625472:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787868895.877194:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1874715939625472:12345-0@lo:900:lod0001_rec0000.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868895.877206:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787868895.877412:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787868895.877467:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:3.0:1787868895.877705:0:17848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93da9393ed00 x1874715939625472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868911 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000040:00080000:0.0:1787868895.877708:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868895.877716:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17848:1874715939625472:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787868895.877769:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787868895.877830:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868895.877856:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da84fc4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787868895.878202:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625600 00000100:00100000:1.0:1787868895.878207:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625600 00000100:00100000:1.0:1787868895.878244:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868895.878252:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625600:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787868895.878322:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1874715939625600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 71us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868895.878348:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868895.878372:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1874715939625600:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787868895.878413:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787868895.878677:0:17821:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1787868895.880808:0:17821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1787868895.882703:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787868895.882778:0:17848:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787868895.882783:0:17848:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1787868895.891451:0:17821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787868895.891496:0:17821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3fe4197f988 00100000:10000000:0.0:1787868895.891506:0:17821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787868895.898820:0:17821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787868895.898861:0:17821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787868895.898882:0:17821:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787868895.898926:0:17821:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787868895.902234:0:17821:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868895.903260:0:17821:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787868896.163600:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868896.738206:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000040:00080000:3.0:1787868896.867045:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787868897.186293:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787868897.514050:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787868897.514068:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab7ec9800 from 8 10000000:01000000:1.0:1787868897.514073:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787868897.514119:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514131:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514143:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868897.514187:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868897.514260:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868897.514322:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868897.514347:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625728 00000100:00100000:1.0:1787868897.514354:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625728 00000100:00100000:1.0:1787868897.514401:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787868897.514409:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+16:17085:x1874715939625728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868897.514423:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868897.514441:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e324 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514477:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514488:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514497:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1600, rc 0) 00000100:00100000:1.0:1787868897.514535:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939625728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868897.514542:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787868897.514591:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868897.514605:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.514614:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868897.514662:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787868897.514691:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868897.514705:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868897.514717:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625856 00000100:00100000:1.0:1787868897.514721:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625856 00000100:00100000:1.0:1787868897.514744:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868897.514751:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939625856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787868897.514774:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787868897.514791:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787868897.514798:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787868897.514873:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939625856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868897.514881:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868897.514907:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787868897.514989:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787868897.514996:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515005:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868897.515014:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787868897.515015:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05e9800 from 8 10000000:01000000:1.0:1787868897.515018:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787868897.515033:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515040:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515048:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868897.515060:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868897.515083:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868897.515095:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868897.515107:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939625984 00000100:00100000:1.0:1787868897.515110:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939625984 00000100:00100000:1.0:1787868897.515141:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868897.515146:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939625984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868897.515153:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868897.515181:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e332 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515195:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515205:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515211:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1400, rc 0) 00000100:00100000:1.0:1787868897.515241:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939625984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868897.515247:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868897.515285:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939625984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868897.515296:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868897.515305:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868897.515342:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939626112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787868897.515368:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868897.515395:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988a42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868897.515697:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626112 00000100:00100000:0.0:1787868897.515702:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626112 00000100:00100000:0.0:1787868897.515734:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868897.515742:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939626112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787868897.515755:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787868897.515778:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787868897.515781:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787868897.515861:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939626112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868897.515868:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787868897.515902:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939626112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787868897.515941:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787868897.515947:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868897.515960:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868897.761785:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000040:00080000:0.0:1787868897.890066:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787868898.209390:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868898.785233:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787868899.233719:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868899.810332:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000001:02000400:3.0:1787868900.103898:0:18090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787868900.262275:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868900.835573:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 0 seconds 00000100:00080000:0.0:1787868901.153399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787868901.153406:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787868901.153410:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868901.153419:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:0.0:1787868901.153424:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1787868901.153429:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939626368:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787868901.153442:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93dab7f72800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868901.153466:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab700f0c0 x1874715939626496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787868901.153482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868901.153486:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868901.153489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868901.153492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868901.153515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868901.153517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868901.153520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787868901.153524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787868901.153529:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787868901.153587:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787868901.153594:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939626240:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.153637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868901.153671:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939626880:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.153712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868901.153743:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939626624:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.153766:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868901.153786:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868901.153790:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939626752:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.153810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868901.153841:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626368 00000100:00100000:2.0:1787868901.153848:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626368 00000100:00100000:2.0:1787868901.153880:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626752 00000100:00100000:2.0:1787868901.153882:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626752 00000100:00100000:2.0:1787868901.153895:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868901.153901:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939626368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868901.153933:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787868901.153998:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874715939626368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868901.154004:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868901.154021:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868901.154027:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939626752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.154070:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939626752:12345-0@lo:400:kworker.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868901.154077:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868901.154099:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626880 00000100:00100000:2.0:1787868901.154103:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626880 00000100:00100000:2.0:1787868901.154126:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626624 00000100:00100000:2.0:1787868901.154129:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626624 00000100:00100000:2.0:1787868901.154139:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868901.154145:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939626880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.154199:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939626880:12345-0@lo:400:kworker.0 Request processed in 53us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868901.154204:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787868901.154213:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868901.154217:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939626624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.154237:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939626624:12345-0@lo:400:kworker.0 Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868901.154242:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868901.154355:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939626496:0@lo:38:kworker.0 00000100:00100000:1.0:1787868901.154402:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868901.154532:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626240 00000100:00100000:0.0:1787868901.154537:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626240 00000100:00100000:2.0:1787868901.154550:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939626496 00000100:00100000:2.0:1787868901.154554:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939626496 00000100:00100000:2.0:1787868901.154566:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868901.154570:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939626496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787868901.154574:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787868901.154579:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:3639:x1874715939626240:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787868901.154593:0:17094:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:0.0:1787868901.154612:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:3639:x1874715939626240:12345-0@lo:400:kworker.0 Request processed in 33us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868901.154618:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000020:00000080:2.0:1787868901.154631:0:17094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e340 00000004:00100000:2.0:1787868901.154647:0:17094:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787868901.154653:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787868901.154932:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939626752:0@lo:400:kworker.0 00010000:00080000:2.0:1787868901.154958:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab700ed00 x1874715939626624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868901.154969:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939626624:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.155465:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939626240:0@lo:400:kworker.0 00010000:00080000:2.0:1787868901.155479:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab700cf00 x1874715939626880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868901.155488:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939626880:0@lo:400:kworker.0 00000100:00100000:2.0:1787868901.155504:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939626368:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787868901.176847:0:17094:0:(import.c:65:import_set_state_nolock()) ffff93daad06b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868901.176954:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939626496:12345-0@lo:38:kworker.0 Request processed in 22380us (22550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868901.176965:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868901.177127:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787868901.177138:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787868901.177147:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787868901.177171:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787868901.177183:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787868901.177198:0:3635:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000019c0a325): req@ffff93da9393f840 x1874715939619328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868901.177217:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939626496:0@lo:38:kworker.0 00000100:00100000:3.0:1787868901.177331:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868901.177364:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868901.177378:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939627008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868901.177401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868901.177433:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939619328 00000100:00100000:3.0:1787868901.177451:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939619328 00000100:00100000:3.0:1787868901.177478:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627008 00000100:00100000:3.0:1787868901.177481:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627008 00000100:00100000:3.0:1787868901.177496:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868901.177503:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17130:x1874715939619328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787868901.177570:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17130:x1874715939619328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868901.177577:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868901.177590:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787868901.177596:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939627008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868901.177617:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787868901.177651:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939627008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868901.177658:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787868901.177685:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939627008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868901.177719:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1874715939619328:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787868901.177803:0:17130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787868901.177836:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1874715939627136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787868901.177864:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868901.177895:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868901.178237:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627136 00000100:00100000:1.0:1787868901.178242:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627136 00000100:00100000:1.0:1787868901.178287:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868901.178294:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17130:x1874715939627136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787868901.178393:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17130:x1874715939627136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868901.178399:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868901.182989:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1874715939627136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787868901.183192:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1874715939627264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787868901.183262:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868901.183304:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868901.183331:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627264 00000100:00100000:3.0:1787868901.183338:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627264 00000100:00100000:3.0:1787868901.183381:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868901.183389:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17130:x1874715939627264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787868901.183495:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17130:x1874715939627264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868901.183502:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868901.185602:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1874715939627264:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787868901.185667:0:17130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868901.194217:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787868901.195241:0:17130:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1787868901.195250:0:17130:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1787868901.215771:0:18142:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868901.217367:0:18142:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787868901.285991:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868902.179857:0:18192:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868902.180148:0:18192:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787868902.305382:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868902.817986:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868903.330288:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787868903.354576:0:18241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc872fe50 20000000:00000080:1.0:1787868903.354595:0:18241:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93daacdd9400 uarg=0000000000000000 20000000:01000000:1.0:1787868903.354641:0:18241:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787868903.354659:0:18241:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787868903.354664:0:18241:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787868903.355769:0:18242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787868903.356127:0:18241:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787868903.369800:0:18241:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787868903.370003:0:18241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370029:0:18241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370036:0:18241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370043:0:18241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370098:0:18241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370117:0:18241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 17 pid: 17082 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868903.370132:0:18241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1874715939627392:0@lo:104: 00000100:00100000:0.0:1787868903.370680:0:18241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787868903.370770:0:18241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868903.370780:0:18241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868903.370789:0:18241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1874715939627520:0@lo:104: 00000100:00100000:0.0:1787868903.370815:0:18241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868903.370843:0:18241:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da92162d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868903.371241:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627392 00000100:00100000:1.0:1787868903.371249:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627392 00000100:00100000:1.0:1787868903.371292:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627520 00000100:00100000:1.0:1787868903.371296:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627520 00000100:00100000:1.0:1787868903.371313:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868903.371323:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:18241:x1874715939627392:12345-0@lo:104: 00010000:00010000:1.0:1787868903.371354:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868903.371417:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868903.371423:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:18241:x1874715939627392:12345-0@lo:104: Request processed in 102us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868903.371431:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868903.371448:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868903.371454:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:18241:x1874715939627520:12345-0@lo:104: 00010000:00010000:1.0:1787868903.371463:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868903.371506:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787868903.371512:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:18241:x1874715939627520:12345-0@lo:104: Request processed in 59us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868903.371519:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787868903.371624:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868903.371632:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371641:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868903.371657:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371666:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868903.371675:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868903.371681:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868903.371731:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371739:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868903.371771:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371778:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0400/0x2f11f4d3bde2e2ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e2f3 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371790:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868903.371793:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371799:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868903.371801:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371809:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868903.371815:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868903.371821:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868903.371835:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371841:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868903.371848:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371865:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031c00/0x2f11f4d3bde2e1e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e1f0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.371879:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868903.371881:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868903.371883:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868903.372024:0:18241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1874715939627392:0@lo:104: 00000100:00100000:0.0:1787868903.372033:0:18241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1874715939627520:0@lo:104: 00010000:00010000:0.0:1787868903.372055:0:18241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868903.372092:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939627648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868903.372124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868903.372210:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868903.372217:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627648 00000100:00100000:1.0:1787868903.372223:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627648 00010000:00010000:1.0:1787868903.372244:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 18 pid: 17082 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868903.372265:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787868903.372272:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+18:3636:x1874715939627648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868903.372281:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868903.372286:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 18 pid: 17082 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868903.372297:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 18 pid: 17082 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868903.372316:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287e00/0x2f11f4d3bde2e2f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e2ec expref: 18 pid: 17082 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868903.372331:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868903.372356:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+17:3636:x1874715939627648:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868903.372363:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787868903.372426:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868903.374367:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939627776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868903.374435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868903.374596:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939627648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868903.377949:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627776 00000100:00100000:3.0:1787868903.377969:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627776 00010000:00010000:3.0:1787868903.378033:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868903.378101:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868903.378112:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+17:3636:x1874715939627776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868903.378129:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868903.378135:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378149:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378189:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e1f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e1e9 expref: 17 pid: 17083 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378504:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378516:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378536:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378544:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378551:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378558:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378577:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868903.378582:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.378591:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.381594:0:18241:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868903.381614:0:18241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.383140:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.383368:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e347 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868903.383392:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868903.384570:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+16:3636:x1874715939627776:12345-0@lo:103:ldlm_bl.0 Request processed in 6455us (10128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868903.384584:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787868903.384680:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939627776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868904.353327:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787868905.057378:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787868905.057386:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab7ec9800 from 13 10000000:01000000:1.0:1787868905.057392:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868905.057442:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.057453:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.057465:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868905.057491:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939627904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868905.057578:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868905.057637:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787868905.057718:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939627904 00000100:00100000:2.0:1787868905.057727:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939627904 00000100:00100000:2.0:1787868905.057797:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787868905.057809:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+16:17085:x1874715939627904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868905.057823:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868905.057837:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e34e expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868905.057862:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868905.057874:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868905.057883:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030600, rc 0) 00000100:00100000:2.0:1787868905.058225:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939627904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 417us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868905.058232:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868905.059758:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939627904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868905.059786:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.059982:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868905.060091:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868905.060150:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868905.060272:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787868905.069196:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628032 00000100:00100000:0.0:1787868905.069214:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628032 00000100:00100000:0.0:1787868905.069296:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787868905.069308:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939628032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868905.069499:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939628032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (9348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868905.069507:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787868905.070017:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868905.070073:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868905.070123:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868905.070243:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868905.075746:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628160 00000100:00100000:1.0:1787868905.075764:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628160 00000100:00100000:1.0:1787868905.075833:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787868905.075843:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939628160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868905.076215:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939628160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (6090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868905.076223:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787868905.076426:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787868905.078090:0:18303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787868905.078447:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787868905.078472:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787868905.078484:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.078496:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868905.078508:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787868905.078510:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05e9800 from 13 10000000:01000000:1.0:1787868905.078513:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787868905.078552:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.078561:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.078656:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868905.078698:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787868905.078900:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868905.079092:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868905.083329:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628288 00000100:00100000:0.0:1787868905.083348:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628288 00000100:00100000:0.0:1787868905.083413:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787868905.083425:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+17:17085:x1874715939628288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868905.083446:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868905.083467:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e35c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868905.083500:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 18 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868905.083513:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 18 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868905.083522:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787868905.083940:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939628288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 516us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868905.083948:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787868905.088817:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868905.088854:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868905.088867:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868905.089230:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868905.089297:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868905.089347:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787868905.089454:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628416 00000100:00100000:0.0:1787868905.089461:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628416 00000100:00100000:0.0:1787868905.089513:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787868905.089524:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939628416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868905.089686:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939628416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868905.089694:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868905.089779:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868905.089825:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868905.089874:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868905.089905:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868905.090142:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628544 00000100:00100000:0.0:1787868905.090146:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628544 00000100:00100000:0.0:1787868905.090202:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787868905.090210:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939628544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868905.090300:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:17085:x1874715939628544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868905.090308:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787868905.090414:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939628544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787868905.092489:0:18304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787868905.093564:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787868905.093593:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787868905.093604:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868905.093627:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868905.249304:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868895/real 1787868895] req@ffff93d9881921c0 x1874715939622528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249335:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d9881921c0 x1874715939622528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249347:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868895/real 1787868895] req@ffff93da9393e580 x1874715939622400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249358:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da9393e580 x1874715939622400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249367:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868890/real 1787868890] req@ffff93d988a80b40 x1874715939620352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249390:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a80b40 x1874715939620352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249400:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868890/real 1787868890] req@ffff93d988a80000 x1874715939620480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.249410:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a80000 x1874715939620480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787868905.249428:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868905.249445:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787868905.249449:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622528:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787868905.249456:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868905.249461:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787868905.249464:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939622400:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787868905.249468:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868905.249472:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787868905.249475:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620352:0@lo:8:kworker.0 00000100:00080000:1.0:1787868905.249479:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868905.249483:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787868905.249485:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939620480:0@lo:8:kworker.0 00000100:00080000:2.0:1787868905.249547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868905.249552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787868905.249555:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868905.249561:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1787868905.249566:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787868905.249572:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93dab7ed8000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868905.249594:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a83c00 x1874715939628800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868905.249621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868905.249629:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787868905.249632:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868905.249635:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1787868905.249637:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787868905.249641:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868905.249654:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a81e00 x1874715939628928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868905.249681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868905.249684:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787868905.249685:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868905.249688:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787868905.249690:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787868905.249693:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab6e72000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868905.249701:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a80000 x1874715939629312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787868905.249708:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868905.249711:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787868905.249712:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868905.249715:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787868905.249717:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787868905.249720:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868905.249729:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988a80b40 x1874715939629440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868905.249759:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939629184:0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.249893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868905.249935:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868905.249941:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939629568:0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.249967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868905.250000:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629568 00000100:00100000:2.0:1787868905.250009:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629568 00000100:00100000:1.0:1787868905.250050:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939629056:0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.250061:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787868905.250071:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939629568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868905.250079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868905.250100:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787868905.250105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939628672:0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.250125:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939629568:12345-0@lo:400:kworker.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868905.250132:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868905.250135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868905.250147:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629056 00000100:00100000:2.0:1787868905.250150:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629056 00000100:00100000:2.0:1787868905.250189:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868905.250192:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629184 00000100:00100000:2.0:1787868905.250195:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939629056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868905.250195:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629184 00000100:00100000:1.0:1787868905.250215:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939628672 00000100:00100000:1.0:1787868905.250218:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939628672 00000100:00100000:2.0:1787868905.250229:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939629056:12345-0@lo:400:kworker.0 Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868905.250232:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868905.250235:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868905.250237:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939629184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868905.250270:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939629184:12345-0@lo:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868905.250276:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868905.250287:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787868905.250291:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d988a83840 x1874715939629056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868905.250292:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939628672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.250304:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939629056:0@lo:400:kworker.0 00000100:00100000:1.0:1787868905.250317:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939628672:12345-0@lo:400:kworker.0 Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868905.250320:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939628672:0@lo:400:kworker.0 00000100:00100000:1.0:1787868905.250323:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868905.250335:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939628800:0@lo:8:kworker.0 00000400:00000100:2.0:1787868905.250360:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939628800 offset 0 length 520: 4 00000100:00100000:2.0:1787868905.250383:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939628928:0@lo:8:kworker.0 00000400:00000100:2.0:1787868905.250410:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939628928 offset 0 length 520: 4 00000100:00100000:2.0:1787868905.250421:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939629312:0@lo:8:kworker.0 00000400:00000100:2.0:1787868905.250441:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939629312 offset 0 length 520: 4 00000100:00100000:2.0:1787868905.250451:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939629440:0@lo:8:kworker.0 00000400:00000100:2.0:1787868905.250468:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939629440 offset 0 length 520: 4 00010000:00080000:2.0:1787868905.250497:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d988a82d00 x1874715939629568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868905.250505:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939629568:0@lo:400:kworker.0 00000100:00100000:2.0:1787868905.250514:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939629184:0@lo:400:kworker.0 00010000:00010000:2.0:1787868905.377277:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868906.273453:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939629696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868906.273523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868906.273584:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629696 00000100:00100000:3.0:1787868906.273604:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629696 00000100:00100000:3.0:1787868906.273649:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787868906.273658:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939629696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868906.274240:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787868906.274328:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939629696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 669us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868906.274337:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868906.274476:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939629696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868906.276009:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939629824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868906.276072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868906.279296:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629824 00000100:00100000:0.0:1787868906.279313:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629824 00000100:00100000:0.0:1787868906.279374:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868906.279385:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939629824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868906.279421:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787868906.280112:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939629824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 726us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868906.280122:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787868906.280239:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939629824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787868906.401520:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787868906.793501:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1787868907.107968:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787868907.425340:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868908.449591:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868909.476945:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868910.370406:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939629952:0@lo:400:kworker.0 00000100:00100000:2.0:1787868910.370488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868910.370639:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939629952 00000100:00100000:0.0:1787868910.370649:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939629952 00000100:00100000:0.0:1787868910.370704:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787868910.370715:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:3636:x1874715939629952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868910.372101:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939630080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868910.372180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868910.374243:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630080 00000100:00100000:1.0:1787868910.374257:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630080 00000100:00100000:1.0:1787868910.374313:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787868910.374338:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868910.374432:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939630080:12345-0@lo:400:kworker.0 Request processed in 111us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868910.374440:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787868910.374583:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939630080:0@lo:400:kworker.0 00000100:00080000:3.0:1787868910.375178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868910.375185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787868910.375188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868910.375191:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787868910.375243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868910.375247:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787868910.375249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868910.375253:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787868910.375316:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868910.375329:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939630464:0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868910.375421:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939630336:0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868910.375466:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868910.375471:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939630208:0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868910.375546:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630336 00000100:00100000:3.0:1787868910.375552:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630336 00000100:00100000:3.0:1787868910.375588:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868910.375784:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939630336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375831:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939630336:12345-0@lo:400:kworker.0 Request processed in 236us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868910.375838:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868910.375868:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939630336:0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375898:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630464 00000100:00100000:3.0:1787868910.375902:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630464 00000100:00100000:3.0:1787868910.375922:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630208 00000100:00100000:3.0:1787868910.375925:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630208 00000100:00100000:3.0:1787868910.375938:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868910.375944:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939630464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.375974:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939630464:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868910.375980:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868910.375991:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787868910.375996:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939630208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868910.376023:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939630208:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868910.376029:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787868910.376053:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d988190780 x1874715939630208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868910.376064:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939630208:0@lo:400:kworker.0 00010000:00080000:3.0:1787868910.376094:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9881921c0 x1874715939630464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868910.376103:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939630464:0@lo:400:kworker.0 00000100:00100000:0.0:1787868910.382349:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+18:3636:x1874715939629952:12345-0@lo:400:kworker.0 Request processed in 11624us (11849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868910.382364:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787868910.382926:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939629952:0@lo:400:kworker.0 00010000:00010000:3.0:1787868910.503139:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868910.893038:0:18590:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787868910.893043:0:18590:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787868910.893044:0:18590:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787868910.893335:0:18590:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93da82b4f800 00000020:01000004:3.0:1787868910.893351:0:18590:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787868910.893366:0:18590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787868910.893380:0:18590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93daaf710000) 00000020:00000080:3.0:1787868910.893398:0:18590:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787868910.939694:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787868910.941914:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787868910.942124:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787868910.942397:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787868910.943184:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787868910.943474:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787868910.943846:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1787868910.947981:0:18590:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787868910.948562:0:18590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787868910.948575:0:18590:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787868910.948587:0:18590:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2e371 00000020:01000004:0.0:1787868910.948605:0:18590:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787868910.948629:0:18590:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787868910.948633:0:18590:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787868910.948652:0:18590:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787868910.948657:0:18590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787868910.948670:0:18590:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93dabda58000) 00000020:00000080:0.0:1787868910.948683:0:18590:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1787868910.952692:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787868910.952940:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787868910.952946:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787868910.961734:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787868910.961751:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787868910.963230:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868910.963241:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787868910.965248:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868910.965455:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787868910.965460:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787868910.967626:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787868910.967639:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787868910.984490:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868910.984897:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787868910.984905:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787868910.987696:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787868910.987713:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787868910.989759:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787868910.989775:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787868910.993672:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868910.993909:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787868910.993916:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787868910.994743:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787868910.994751:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787868911.043343:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787868911.043572:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787868911.043578:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787868911.049882:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787868911.049987:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787868911.050706:0:18590:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787868911.050735:0:18590:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787868911.050742:0:18590:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787868911.075468:0:18590:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787868911.075560:0:18590:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787868911.075566:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787868911.075567:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787868911.075569:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868911.075570:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868911.075571:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868911.075572:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868911.075574:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868911.075575:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868911.075577:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868911.075580:0:18590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787868911.075582:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787868911.075583:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787868911.075584:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868911.075585:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868911.075586:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868911.075588:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868911.075589:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868911.075590:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868911.075591:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868911.075644:0:18590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787868911.075667:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787868911.075744:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.075795:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868911.075972:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630592 00000100:00100000:2.0:1787868911.075980:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630592 00000100:00100000:2.0:1787868911.076035:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787868911.076045:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:18590:x1874715939630592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787868911.076090:0:17081:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787868911.076094:0:17081:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787868911.076098:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787868911.076932:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:18590:x1874715939630592:12345-0@lo:253:mount.lustre.0 Request processed in 883us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868911.076945:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787868911.077073:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787868911.077087:0:18590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787868911.077090:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868911.077091:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868911.077093:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868911.077094:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868911.077095:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868911.077096:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868911.077098:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868911.077099:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868911.077100:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787868911.077123:0:18590:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93da82b4f800 from lustre-OST0000 10000000:01000000:0.0:1787868911.077195:0:18590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787868911.077199:0:18590:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787868911.077209:0:18590:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd849a48 local copy 00010000:00010000:0.0:1787868911.077221:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868911.077350:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868911.077387:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.077421:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.077514:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630720 00000100:00100000:1.0:1787868911.077520:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630720 00000100:00100000:1.0:1787868911.077636:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787868911.077646:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:18590:x1874715939630720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868911.077716:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+18:18590:x1874715939630720:12345-0@lo:501:mount.lustre.0 Request processed in 72us (329us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787868911.077723:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787868911.077828:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630720:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787868911.077842:0:18590:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787868911.077861:0:18590:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787868911.077868:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.077877:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868911.077903:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93da82b4f800 10000000:01000000:0.0:1787868911.077908:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787868911.077913:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787868911.077916:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868911.077921:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787868911.077923:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787868911.077944:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.077952:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.077962:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868911.077975:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868911.078000:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.079996:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.080050:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630848 00000100:00100000:3.0:1787868911.080058:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630848 00000100:00100000:3.0:1787868911.080103:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787868911.080111:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+18:18590:x1874715939630848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868911.080124:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868911.080141:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e37f expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.080237:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e37f expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.080264:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e37f expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.080274:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c000, rc 0) 00000100:00100000:3.0:1787868911.080375:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939630848:12345-0@lo:101:mount.lustre.0 Request processed in 264us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.080383:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787868911.082795:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868911.082845:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.082859:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868911.088205:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787868911.088894:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868911.094937:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787868911.094997:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787868911.095015:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787868911.095030:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787868911.095052:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787868911.095085:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787868911.095115:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787868911.095121:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787868911.096313:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868911.096387:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.096443:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787868911.096552:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939630976 00000100:00100000:2.0:1787868911.096560:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939630976 00000100:00100000:2.0:1787868911.096630:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787868911.096640:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939630976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868911.096810:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939630976:12345-0@lo:501:mount.lustre.0 Request processed in 171us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868911.096829:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787868911.097037:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939630976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868911.097072:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787868911.097111:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.097125:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868911.099295:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631104 00000100:00100000:0.0:1787868911.099309:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631104 00000100:00100000:0.0:1787868911.099376:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787868911.099386:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868911.101053:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631104:12345-0@lo:503:mount.lustre.0 Request processed in 1662us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868911.101065:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787868911.101209:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787868911.101835:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868911.101930:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868911.101988:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.102910:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.104056:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631232 00000100:00100000:1.0:1787868911.104066:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631232 00000100:00100000:1.0:1787868911.104304:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787868911.104315:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.105918:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631232:12345-0@lo:502:mount.lustre.0 Request processed in 1599us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.105932:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787868911.106902:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787868911.107252:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787868911.107287:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787868911.107301:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787868911.107314:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787868911.107325:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787868911.107336:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787868911.107348:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787868911.107360:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787868911.107372:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787868911.107383:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787868911.107394:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787868911.107405:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787868911.107459:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868911.107539:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.108039:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.108121:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631360 00000100:00100000:1.0:1787868911.108128:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631360 00000100:00100000:1.0:1787868911.108204:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787868911.108215:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.108347:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631360:12345-0@lo:502:mount.lustre.0 Request processed in 133us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.108356:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787868911.108568:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787868911.108817:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787868911.108830:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787868911.109940:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787868911.109950:0:18607:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787868911.109958:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.109960:0:18607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787868911.109965:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787868911.109981:0:18607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93dabd2f9a48) 00000020:00000080:2.0:1787868911.110006:0:18607:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787868911.110012:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787868911.110109:0:18607:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93da82b4f800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787868911.110119:0:18607:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787868911.110128:0:18607:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2e394 00010000:00010000:2.0:1787868911.116679:0:18607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787868911.117102:0:18607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1787868911.118754:0:18607:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787868911.124876:0:18607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787868911.124888:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868911.124896:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124898:0:18607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787868911.124902:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787868911.124904:0:18607:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787868911.124906:0:18607:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787868911.124908:0:18607:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787868911.124909:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787868911.124911:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124913:0:18607:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787868911.124915:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868911.124917:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124918:0:18607:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787868911.124921:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787868911.124922:0:18607:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787868911.124924:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868911.124937:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124939:0:18607:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787868911.124941:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787868911.124944:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124945:0:18607:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787868911.124948:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787868911.124977:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787868911.124979:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787868911.124981:0:18607:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787868911.124984:0:18607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787868911.127863:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787868911.127915:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787868911.127939:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.127953:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868911.127963:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93da82b4f800 from 1 10000000:01000000:0.0:1787868911.127966:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868911.128004:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.128013:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.128037:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868911.128064:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868911.128141:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.128202:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.128324:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631488 00000100:00100000:1.0:1787868911.128332:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631488 00000100:00100000:1.0:1787868911.128384:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787868911.128394:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:18590:x1874715939631488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868911.128408:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868911.128423:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e39b expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.128445:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.128456:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.128477:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0c00, rc 0) 00000100:00100000:1.0:1787868911.128541:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631488:12345-0@lo:101:mount.lustre.0 Request processed in 149us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.128548:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787868911.128744:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868911.128759:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.128769:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868911.131682:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787868911.131980:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868911.132237:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787868911.132262:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787868911.132280:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787868911.132286:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787868911.132356:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868911.132419:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.132457:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.132717:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631616 00000100:00100000:1.0:1787868911.132726:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631616 00000100:00100000:1.0:1787868911.132774:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787868911.132784:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868911.132889:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631616:12345-0@lo:501:mount.lustre.0 Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.132897:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787868911.133715:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868911.133762:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868911.133820:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.133899:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.138246:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631744 00000100:00100000:1.0:1787868911.138261:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631744 00000100:00100000:1.0:1787868911.138335:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868911.138346:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787868911.138715:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631744:12345-0@lo:503:mount.lustre.0 Request processed in 369us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.138724:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868911.139029:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787868911.139901:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868911.139988:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.140048:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.140091:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878540 going to sleep for 11 seconds 00000100:00100000:0.0:1787868911.140196:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939631872 00000100:00100000:0.0:1787868911.140202:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939631872 00000100:00100000:0.0:1787868911.140245:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787868911.140255:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868911.140365:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939631872:12345-0@lo:502:mount.lustre.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868911.140372:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868911.140518:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939631872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868911.140702:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787868911.140725:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787868911.140738:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787868911.140749:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787868911.140760:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787868911.140770:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787868911.140782:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787868911.140792:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787868911.140816:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787868911.140829:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787868911.140840:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787868911.140859:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.140892:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.140923:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878540 going to sleep for 11 seconds 00000100:00100000:0.0:1787868911.140972:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632000 00000100:00100000:0.0:1787868911.140977:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632000 00000100:00100000:0.0:1787868911.141010:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787868911.141018:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939632000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868911.141094:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939632000:12345-0@lo:502:mount.lustre.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868911.141100:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787868911.141211:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787868911.141253:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787868911.141261:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787868911.142388:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868911.142400:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142403:0:18611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787868911.142409:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93da82b4f800 00000020:00000080:0.0:1787868911.142412:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787868911.142419:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868911.142421:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142422:0:18611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787868911.142424:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868911.142426:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142427:0:18611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787868911.142430:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93da82b4f800 00000020:00000080:0.0:1787868911.142432:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787868911.142505:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868911.142509:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142511:0:18611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787868911.142521:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868911.142525:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142526:0:18611:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787868911.142538:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93da82b4f800 00000020:00000080:0.0:1787868911.142542:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787868911.142563:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868911.142566:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142567:0:18611:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787868911.142570:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787868911.142572:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.142573:0:18611:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787868911.142577:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93da82b4f800 00000020:00000080:0.0:1787868911.142579:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787868911.144144:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787868911.144169:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787868911.144172:0:18611:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787868911.144177:0:18611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787868911.144292:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787868911.144321:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787868911.144348:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.144361:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868911.144419:0:18590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787868911.144422:0:18590:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93da82b4f800 10000000:01000000:1.0:1787868911.144425:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93da82b4f800 10000000:01000000:1.0:1787868911.144466:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787868911.144472:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93da82b4f800 from 1 10000000:01000000:1.0:1787868911.144474:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787868911.144520:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.144538:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.144550:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868911.144573:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868911.144644:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.144685:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878240 going to sleep for 11 seconds 00000100:00100000:2.0:1787868911.147547:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632128 00000100:00100000:2.0:1787868911.147562:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632128 00000100:00100000:2.0:1787868911.147740:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787868911.147753:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+20:18590:x1874715939632128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868911.147773:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868911.147797:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e3b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e3a9 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868911.147826:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3a9 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868911.147838:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3a9 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868911.147847:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93da80030e00, rc 0) 00000100:00100000:2.0:1787868911.147938:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632128:12345-0@lo:101:mount.lustre.0 Request processed in 188us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868911.147945:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787868911.147971:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868911.147990:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.148000:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868911.151446:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787868911.151753:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868911.152024:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787868911.152048:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787868911.152063:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787868911.152076:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787868911.152091:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787868911.152105:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787868911.152119:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787868911.152131:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787868911.152178:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787868911.152195:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787868911.152219:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787868911.152231:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787868911.152243:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787868911.152261:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787868911.152926:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787868911.152948:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787868911.152962:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787868911.152975:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787868911.152988:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787868911.153000:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787868911.153014:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787868911.153028:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787868911.153040:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787868911.153051:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787868911.153076:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787868911.153092:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787868911.153105:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787868911.153118:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787868911.153131:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787868911.153144:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787868911.153192:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787868911.153209:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787868911.153223:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787868911.153237:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787868911.153249:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787868911.153263:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787868911.153437:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787868911.153463:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787868911.153469:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787868911.153584:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868911.153655:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.153703:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.154051:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632256 00000100:00100000:3.0:1787868911.154058:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632256 00000100:00100000:3.0:1787868911.154112:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787868911.154128:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868911.154292:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632256:12345-0@lo:501:mount.lustre.0 Request processed in 166us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.154301:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787868911.154378:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868911.154413:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787868911.154450:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.154482:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878180 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.154526:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632384 00000100:00100000:3.0:1787868911.154540:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632384 00000100:00100000:3.0:1787868911.154571:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787868911.154578:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787868911.154665:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632384:12345-0@lo:503:mount.lustre.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.154671:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787868911.154878:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787868911.155373:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868911.155457:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.155513:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.155533:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.155924:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632512 00000100:00100000:3.0:1787868911.155931:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632512 00000100:00100000:3.0:1787868911.156048:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868911.156057:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868911.156181:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632512:12345-0@lo:502:mount.lustre.0 Request processed in 125us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.156188:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787868911.156188:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868911.156444:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787868911.156470:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787868911.156481:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787868911.156492:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787868911.156517:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787868911.156528:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787868911.156541:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787868911.156554:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787868911.156566:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787868911.156579:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787868911.156592:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787868911.156606:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787868911.156619:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787868911.156631:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787868911.156643:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787868911.156656:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787868911.156683:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787868911.156697:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787868911.156720:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787868911.156731:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787868911.156744:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787868911.156757:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787868911.156774:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787868911.156789:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787868911.156803:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787868911.156815:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787868911.157364:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787868911.157397:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787868911.157411:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787868911.157424:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787868911.157437:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787868911.157450:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787868911.157478:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787868911.157504:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787868911.157521:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787868911.157535:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787868911.157549:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787868911.157562:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787868911.157574:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787868911.157586:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787868911.157600:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787868911.157613:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787868911.157625:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787868911.157637:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787868911.157650:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787868911.157664:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787868911.157678:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787868911.157691:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787868911.157751:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868911.157811:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.158392:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878240 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.161734:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632640 00000100:00100000:3.0:1787868911.161750:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632640 00000100:00100000:3.0:1787868911.161813:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868911.161823:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868911.162116:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632640:12345-0@lo:502:mount.lustre.0 Request processed in 293us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.162125:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787868911.162287:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787868911.162520:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787868911.162901:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787868911.162946:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868911.163093:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868911.163141:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa07d2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.163262:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632768 00000100:00100000:3.0:1787868911.163276:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632768 00000100:00100000:3.0:1787868911.163318:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868911.163326:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868911.163416:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939632768:12345-0@lo:502:mount.lustre.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.163424:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787868911.163517:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939632768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787868911.163707:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787868911.163715:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787868911.171857:0:18616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787868911.171896:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d987f80000) 00000020:00000080:3.0:1787868911.171923:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787868911.183216:0:18616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93da82b4f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787868911.183227:0:18616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93da82b4f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787868911.183230:0:18616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93da82b4f800 3 00010000:00080000:3.0:1787868911.183275:0:18616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab5b21000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868911.187789:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787868911.187970:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787868911.188017:0:18616:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787868911.188032:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2f11f4d3bde2e3be 00000100:00080000:3.0:1787868911.188043:0:18616:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868911.188049:0:18616:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93dab5b21000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868911.188087:0:18616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f95e00 x1874715939632896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868911.188117:0:18616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787868911.188188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868911.188192:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868911.188195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868911.188197:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868911.188220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868911.188223:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868911.188226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868911.188229:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787868911.188262:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939633152:0@lo:400:kworker.0 00000100:00100000:1.0:1787868911.188339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.188375:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868911.188377:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939632896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787868911.188379:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939633280:0@lo:400:kworker.0 00000100:00100000:1.0:1787868911.188405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868911.188406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868911.188446:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939633408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868911.188469:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868911.188486:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868911.188491:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939633024:0@lo:400:kworker.0 00000100:00100000:2.0:1787868911.188527:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.188859:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633152 00000100:00100000:3.0:1787868911.188866:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633152 00000100:00100000:3.0:1787868911.188898:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939632896 00000100:00100000:3.0:1787868911.188901:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939632896 00000100:00100000:3.0:1787868911.188910:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633408 00000100:00100000:3.0:1787868911.188912:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633408 00000100:00100000:3.0:1787868911.188927:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868911.188941:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868911.188998:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939633152:12345-0@lo:400:kworker.0 Request processed in 58us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.189005:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787868911.189021:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868911.189027:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939633408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868911.189106:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939633408:12345-0@lo:400:kworker.0 Request processed in 78us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.189113:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868911.189125:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868911.189129:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939632896:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787868911.189150:0:17089:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1787868911.189202:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2e3c5 00000004:00100000:3.0:1787868911.189219:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787868911.189252:0:17089:0:(import.c:65:import_set_state_nolock()) ffff93d986fa5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868911.189290:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874715939632896:12345-0@lo:38:llog_process_th.0 Request processed in 160us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.189296:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868911.189317:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633280 00000100:00100000:3.0:1787868911.189320:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633280 00000100:00100000:3.0:1787868911.189335:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633024 00000100:00100000:3.0:1787868911.189338:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633024 00000100:00100000:3.0:1787868911.189350:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868911.189356:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868911.189388:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939633280:12345-0@lo:400:kworker.0 Request processed in 33us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.189402:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787868911.189415:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868911.189421:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868911.189449:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939633024:12345-0@lo:400:kworker.0 Request processed in 28us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.189454:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868911.189515:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939633280:0@lo:400:kworker.0 00010000:00080000:3.0:1787868911.189540:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab7f0c3c0 x1874715939633152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868911.189553:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939633152:0@lo:400:kworker.0 00010000:00080000:3.0:1787868911.189601:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d986f95e00 x1874715939632896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868911.189609:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787868911.189616:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787868911.189633:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787868911.189638:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787868911.189641:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787868911.189646:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939632896:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787868911.189944:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab7f0d2c0 x1874715939633408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868911.189955:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939633408:0@lo:400:kworker.0 00000100:00100000:2.0:1787868911.189970:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939633024:0@lo:400:kworker.0 00000020:01000004:3.0:1787868911.191072:0:18616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787868911.191089:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d987f81a48) 00000020:00000080:3.0:1787868911.191114:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787868911.191379:0:18616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93da82b4f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787868911.191383:0:18616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93da82b4f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787868911.191386:0:18616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93da82b4f800 3 00010000:00080000:3.0:1787868911.191430:0:18616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d987fb7800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787868911.194232:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787868911.194416:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787868911.194461:0:18616:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787868911.194475:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2f11f4d3bde2e3d3 00000100:00080000:3.0:1787868911.194485:0:18616:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787868911.194491:0:18616:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d987fb7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868911.194540:0:18616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f95e00 x1874715939633536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868911.194581:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939633536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787868911.194654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.194712:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633536 00000100:00100000:3.0:1787868911.194719:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633536 00000100:00100000:3.0:1787868911.194750:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868911.194758:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939633536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787868911.194783:0:17089:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1787868911.194824:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2e3da 00000004:00100000:3.0:1787868911.194839:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787868911.194874:0:17089:0:(import.c:65:import_set_state_nolock()) ffff93d987fb0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868911.194933:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874715939633536:12345-0@lo:38:llog_process_th.0 Request processed in 175us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.194941:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787868911.194963:0:18616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:0.0:1787868911.195043:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d986f95e00 x1874715939633536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868911.195054:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868911.195062:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787868911.195069:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787868911.195073:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787868911.195075:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d987fb7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787868911.195082:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939633536:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787868911.195390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868911.195396:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868911.195399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868911.195412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868911.195416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868911.195420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868911.195423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787868911.195426:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787868911.201514:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787868911.202453:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787868911.203040:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868911.203060:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.203074:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868911.203134:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787868911.203238:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868911.203240:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868911.203242:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868911.203244:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868911.203246:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868911.203249:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868911.203251:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868911.203253:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868911.203258:0:18590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787868911.203261:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868911.203263:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787868911.203265:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868911.203266:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868911.203268:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868911.203269:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868911.203271:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868911.203278:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868911.203279:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868911.203376:0:18590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787868911.203398:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939633664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787868911.203469:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.203513:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633664 00000100:00100000:3.0:1787868911.203522:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633664 00000100:00100000:0.0:1787868911.203531:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868911.203582:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868911.206713:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939633664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787868911.206909:0:17083:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787868911.206926:0:17083:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787868911.211540:0:17083:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787868911.211563:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787868911.211598:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787868911.211604:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787868911.211628:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211648:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211656:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211663:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211709:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211724:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 21 pid: 17081 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868911.211740:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939633792:0@lo:104: 00000100:00100000:1.0:1787868911.211841:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868911.211893:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.211901:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868911.211910:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939633920:0@lo:104: 00000100:00100000:1.0:1787868911.211935:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868911.211952:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868911.211981:0:17071:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787868911.211998:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633792 00000100:00100000:1.0:1787868911.212004:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633792 00000100:00100000:1.0:1787868911.212040:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939633920 00000100:00100000:1.0:1787868911.212043:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939633920 00000100:00100000:1.0:1787868911.212057:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868911.212065:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939633792:12345-0@lo:104: 00010000:00010000:1.0:1787868911.212077:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212130:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868911.212143:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939633792:12345-0@lo:104: Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.212151:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868911.212190:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868911.212196:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84269c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939633920:12345-0@lo:104: 00010000:00010000:1.0:1787868911.212204:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212235:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787868911.212239:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:18590:x1874715939633664:12345-0@lo:253:mount.lustre.0 Request processed in 8647us (8769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.212239:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84269c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939633920:12345-0@lo:104: Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.212246:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868911.212248:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868911.212296:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:18590:1874715939633664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787868911.212296:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939633792:0@lo:104: 00000100:00100000:1.0:1787868911.212305:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939633920:0@lo:104: 10000000:01000000:3.0:1787868911.212307:0:18590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787868911.212311:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787868911.212313:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787868911.212315:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787868911.212316:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787868911.212317:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787868911.212318:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787868911.212320:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787868911.212322:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787868911.212323:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1787868911.212324:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1787868911.212333:0:18590:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787868911.212343:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787868911.212348:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212355:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868911.212359:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212367:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868911.212373:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868911.212385:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868911.212421:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212427:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868911.212447:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212453:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0e00/0x2f11f4d3bde2e332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e339 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212462:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868911.212465:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212471:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868911.212473:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212479:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868911.212486:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868911.212490:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787868911.212516:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212522:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868911.212543:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212550:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1a00/0x2f11f4d3bde2e324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e32b expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.212563:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868911.212566:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868911.212568:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868911.212574:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868911.212581:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868911.212591:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939634048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787868911.212619:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868911.212893:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939634176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868911.212924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.212955:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634048 00000100:00100000:0.0:1787868911.212969:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634048 00000100:00100000:3.0:1787868911.212987:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634176 00000100:00100000:3.0:1787868911.212992:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634176 00010000:00010000:0.0:1787868911.212994:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 21 pid: 17081 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.213009:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 22 pid: 17082 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868911.213027:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868911.213037:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+22:3636:x1874715939634048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868911.213048:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868911.213054:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 22 pid: 17081 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.213067:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 22 pid: 17081 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.213083:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2e339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e332 expref: 22 pid: 17081 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868911.213095:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868911.213151:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+21:3636:x1874715939634048:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868911.213247:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939634048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787868911.214982:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787868911.214995:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787868911.216899:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868911.216925:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+21:3638:x1874715939634176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787868911.216947:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868911.216956:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.216982:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217005:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e32b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e324 expref: 21 pid: 17082 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217023:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217032:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787868911.217052:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005447541s 00010000:00010000:3.0:1787868911.217057:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217063:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217069:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217078:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217084:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868911.217088:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217096:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217129:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868911.217140:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868911.217277:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+20:3638:x1874715939634176:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (4351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868911.217286:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787868911.217345:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939634176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868911.217699:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.217708:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868911.217714:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb1c00/0x2f11f4d3bde2e3e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868911.219428:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00000004:0.0:1787868911.220843:0:18590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787868911.225522:0:18590:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787868911.225532:0:18590:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787868911.225576:0:18590:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787868911.225793:0:18590:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787868911.225820:0:18590:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787868911.225845:0:18590:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787868911.226904:0:18590:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868911.230902:0:18590:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787868911.393738:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939634304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868911.393817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.393918:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939634432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868911.394056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868911.394479:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634304 00000100:00100000:0.0:1787868911.394488:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634304 00000100:00100000:0.0:1787868911.394538:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634432 00000100:00100000:0.0:1787868911.394541:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634432 00000100:00100000:0.0:1787868911.394559:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868911.394567:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939634304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868911.394603:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787868911.395983:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939634304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1409us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868911.395995:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868911.396023:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787868911.396036:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939634432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868911.396063:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787868911.396139:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939634432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868911.396146:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787868911.396210:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939634432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868911.396257:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939634304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787868911.526929:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787868912.033902:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1787868912.306810:0:18671:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787868912.307378:0:18671:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787868912.545354:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787868912.801265:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787868912.801273:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab7ec9800 from 9 10000000:01000000:0.0:1787868912.801277:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787868912.801326:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.801354:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.801365:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868912.801409:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868912.801484:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868912.801532:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868912.801556:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634560 00000100:00100000:3.0:1787868912.801564:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634560 00000100:00100000:3.0:1787868912.801691:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868912.801701:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+19:17085:x1874715939634560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868912.801715:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868912.801728:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e3e8 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868912.801750:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868912.801761:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868912.801770:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d800, rc 0) 00000100:00100000:3.0:1787868912.801817:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+20:17085:x1874715939634560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868912.801824:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787868912.801849:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868912.801867:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.801876:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868912.801923:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787868912.801953:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868912.801975:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868912.801996:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634688 00000100:00100000:1.0:1787868912.802001:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634688 00000100:00100000:1.0:1787868912.802024:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787868912.802037:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:17085:x1874715939634688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787868912.802051:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787868912.802068:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787868912.802071:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787868912.802194:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:17085:x1874715939634688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868912.802201:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787868912.802316:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787868912.802376:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787868912.802383:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.802831:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868912.802851:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787868912.802853:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05e9800 from 9 10000000:01000000:0.0:1787868912.802856:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787868912.802874:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.802881:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868912.802888:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868912.802902:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868912.802931:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868912.803004:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787868912.808538:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634816 00000100:00100000:1.0:1787868912.808783:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634816 00000100:00100000:1.0:1787868912.808929:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868912.808941:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+20:17085:x1874715939634816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868912.808960:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868912.808979:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e3f6 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868912.809019:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868912.809032:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868912.809042:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0400, rc 0) 00000100:00100000:1.0:1787868912.809126:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939634816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (6193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868912.809133:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787868912.809231:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868912.809261:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868912.809270:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868912.809339:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787868912.809375:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868912.810376:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa07d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868912.814351:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939634944 00000100:00100000:3.0:1787868912.814397:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939634944 00000100:00100000:2.0:1787868912.814541:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787868912.814555:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939634944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787868912.814583:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787868912.814602:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787868912.814606:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787868912.814763:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939634944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868912.814771:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787868912.815502:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939634944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787868912.815582:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787868912.815592:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868912.815609:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868913.570236:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868914.598096:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868915.617587:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868916.514330:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939635072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868916.514431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.514517:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635072 00000100:00100000:2.0:1787868916.514525:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635072 00000100:00100000:2.0:1787868916.514577:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868916.514587:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939635072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868916.514623:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787868916.514676:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939635072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.514699:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868916.514753:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939635072:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787868916.515696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868916.515702:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868916.515706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868916.515709:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868916.515729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868916.515732:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787868916.515735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787868916.515737:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787868916.516427:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939635328:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.516543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939635840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.516594:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787868916.516600:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939635200:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.516650:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939635712:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.516704:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635328 00000100:00100000:2.0:1787868916.516712:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635328 00000100:00100000:2.0:1787868916.516742:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635840 00000100:00100000:2.0:1787868916.516745:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635840 00000100:00100000:2.0:1787868916.516770:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635712 00000100:00100000:2.0:1787868916.516773:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635712 00000100:00100000:2.0:1787868916.516791:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868916.516798:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516850:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939635328:12345-0@lo:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.516857:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868916.516874:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868916.516880:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939635840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516906:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939635840:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.516922:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787868916.516934:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868916.516940:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939635712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.516969:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939635712:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.516974:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868916.516996:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635200 00000100:00100000:2.0:1787868916.516999:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635200 00000100:00100000:2.0:1787868916.517022:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787868916.517027:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939635200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.517054:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939635200:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.517059:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787868916.517104:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868916.517108:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868916.517129:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939635200:0@lo:400:kworker.0 00010000:00080000:2.0:1787868916.517143:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0e580 x1874715939635712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868916.517177:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939635712:0@lo:400:kworker.0 00010000:00080000:2.0:1787868916.517188:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0e940 x1874715939635328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868916.517196:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939635328:0@lo:400:kworker.0 00010000:00080000:2.0:1787868916.517203:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0d680 x1874715939635840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868916.517222:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939635840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.517255:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939635456:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.521108:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939635968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868916.521137:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.521180:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868916.521190:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939635584:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868916.521266:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635456 00000100:00100000:2.0:1787868916.521276:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635456 00000100:00100000:2.0:1787868916.521325:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635968 00000100:00100000:2.0:1787868916.521328:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635968 00000100:00100000:2.0:1787868916.521345:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868916.521353:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939635456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521433:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939635456:12345-0@lo:400:kworker.0 Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.521441:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868916.521463:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787868916.521469:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939635968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868916.521500:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787868916.521538:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939635968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.521546:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787868916.521567:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939635584 00000100:00100000:2.0:1787868916.521571:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939635584 00000100:00100000:2.0:1787868916.521618:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868916.521625:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939635584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521662:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939635584:12345-0@lo:400:kworker.0 Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868916.521668:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787868916.521721:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0de00 x1874715939635584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868916.521736:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939635584:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521749:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939635456:0@lo:400:kworker.0 00000100:00100000:2.0:1787868916.521764:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939635968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787868916.647479:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868917.345951:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868917.665447:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868918.694577:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787868918.856700:0:18961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787868919.713508:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787868919.937405:0:19013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868919.937623:0:19013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787868920.418571:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868905/real 1787868905] req@ffff93d988a80000 x1874715939629312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.418605:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a80000 x1874715939629312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.418615:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868905/real 1787868905] req@ffff93d988a80b40 x1874715939629440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.418627:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a80b40 x1874715939629440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868920.418649:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868920.418680:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868920.418684:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939629312:0@lo:8:kworker.0 00000100:00080000:0.0:1787868920.418694:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868920.418704:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868920.418719:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939629440:0@lo:8:kworker.0 00000100:00100000:0.0:1787868920.419793:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939636096:0@lo:400:kworker.0 00000100:00100000:0.0:1787868920.419862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868920.419994:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868920.419999:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787868920.420002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868920.420005:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787868920.420477:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636096 00000100:00100000:3.0:1787868920.420486:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636096 00000100:00100000:3.0:1787868920.420661:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787868920.420674:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:3637:x1874715939636096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868920.421515:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939636224:0@lo:400:kworker.0 00000100:00100000:1.0:1787868920.421573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868920.421609:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787868920.421616:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939636352:0@lo:400:kworker.0 00000100:00100000:1.0:1787868920.421644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868920.421675:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939636480:0@lo:400:kworker.0 00000100:00100000:1.0:1787868920.421716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787868920.424533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868920.424541:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787868920.424545:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868920.424553:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00100000:3.0:1787868920.424558:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:3637:x1874715939636096:12345-0@lo:400:kworker.0 Request processed in 3880us (4688us total) trans 0 rc 0/0 00000100:00080000:2.0:1787868920.424560:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787868920.424570:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab6e72000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868920.424668:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787868920.424693:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636224 00000100:00100000:2.0:1787868920.424702:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636224 00000100:00100000:3.0:1787868920.424921:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636480 00000100:00100000:3.0:1787868920.424927:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636480 00000100:00100000:3.0:1787868920.424963:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787868920.424971:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939636480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.425055:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939636480:12345-0@lo:400:kworker.0 Request processed in 84us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.425062:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787868920.425075:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868920.425081:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939636224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.425120:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939636224:12345-0@lo:400:kworker.0 Request processed in 39us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.425126:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787868920.425180:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636352 00000100:00100000:3.0:1787868920.425184:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636352 00000100:00100000:3.0:1787868920.425214:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868920.425221:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939636352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.425343:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939636352:12345-0@lo:400:kworker.0 Request processed in 121us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.425358:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868920.425417:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f94780 x1874715939636608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868920.425444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868920.425449:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787868920.425452:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868920.425457:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1787868920.425460:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787868920.425465:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868920.425483:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939636608:0@lo:8:kworker.0 00000100:00100000:3.0:1787868920.425526:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787868920.425658:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6e99e00 x1874715939636352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.425674:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787868920.425691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939636224:0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.425706:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f95a40 x1874715939636736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868920.425731:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939636736:0@lo:8:kworker.0 00000100:00100000:3.0:1787868920.425763:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.425813:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868920.425854:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939636480:0@lo:400:kworker.0 00000100:00100000:0.0:1787868920.425864:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868920.425870:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939636864:0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.425895:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939636992:0@lo:400:kworker.0 00000100:00100000:0.0:1787868920.425905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.425933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868920.426060:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939636096:0@lo:400:kworker.0 00000100:00100000:1.0:1787868920.426465:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636608 00000100:00100000:1.0:1787868920.426471:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636608 00000100:00100000:1.0:1787868920.426493:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636736 00000100:00100000:1.0:1787868920.426495:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636736 00000100:00100000:1.0:1787868920.426506:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868920.426511:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939636608:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787868920.426535:0:18594:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1787868920.426564:0:18594:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e404 00002000:00100000:1.0:1787868920.426578:0:18594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93d987e8e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787868920.426582:0:18594:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787868920.426585:0:18594:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787868920.426774:0:18594:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787868920.426803:0:18594:0:(import.c:65:import_set_state_nolock()) ffff93d987e8c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868920.426861:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939636608:12345-0@lo:8:kworker.0 Request processed in 348us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868920.426868:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787868920.426885:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868920.426889:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939636736:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787868920.426901:0:18594:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787868920.428499:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636864 00000100:00100000:3.0:1787868920.428512:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636864 00000100:00100000:3.0:1787868920.428565:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939636992 00000100:00100000:3.0:1787868920.428569:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939636992 00000100:00100000:3.0:1787868920.428601:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868920.428610:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939636864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.428692:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939636864:12345-0@lo:400:kworker.0 Request processed in 83us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.428722:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868920.428742:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787868920.428749:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939636992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.428786:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939636992:12345-0@lo:400:kworker.0 Request processed in 38us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.428792:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787868920.428818:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787868920.428852:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97c00 x1874715939636864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868920.428866:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939636864:0@lo:400:kworker.0 00010000:00080000:3.0:1787868920.428904:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f96940 x1874715939636992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868920.428913:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939636992:0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.428963:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939637120:0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.428995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.429025:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637120 00000100:00100000:3.0:1787868920.429028:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637120 00000100:00100000:3.0:1787868920.429053:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787868920.429059:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939637120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868920.429090:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939637120:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868920.429096:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787868920.429111:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868920.429126:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f96940 x1874715939637120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868920.429142:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939637120:0@lo:400:kworker.0 00010000:00080000:0.0:1787868920.434351:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f94780 x1874715939636608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.434367:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868920.434378:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787868920.434388:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787868920.434395:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787868920.434399:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787868920.435583:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787868920.435611:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939636608:0@lo:8:kworker.0 00000004:00080000:0.0:1787868920.435677:0:17830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787868920.436577:0:17830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 544562420158ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787868920.436587:0:17830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1787868920.439300:0:17822:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:3.0:1787868920.441963:0:17831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787868920.441995:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637376:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787868920.442072:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.442124:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868920.442131:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787868920.442173:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868920.442285:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868920.442299:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939637248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868920.442362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.442409:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637376 00000100:00100000:3.0:1787868920.442416:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637376 00000100:00080000:3.0:1787868920.442470:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868920.442545:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868920.442555:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17831:x1874715939637376:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787868920.443133:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637248 00000100:00100000:2.0:1787868920.443140:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637248 00000100:00100000:2.0:1787868920.443194:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787868920.443201:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874715939637248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868920.443221:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787868920.443280:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874715939637248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868920.443287:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787868920.443338:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f96940 x1874715939637248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868920.443356:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939637248:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1787868920.447790:0:19034:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787868920.447798:0:19034:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787868920.447947:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17831:x1874715939637376:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5388us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868920.447967:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868920.449796:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939636736:12345-0@lo:8:kworker.0 Request processed in 22898us (24025us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868920.449811:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787868920.450443:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868920.450451:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787868920.450455:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939636736:0@lo:8:kworker.0 00010000:00080000:3.0:1787868920.451528:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f94000 x1874715939637376/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868936 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868920.451545:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637376:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787868920.451560:0:17831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787868920.451602:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637504:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787868920.451653:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.451723:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868920.451767:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637504 00000100:00100000:0.0:1787868920.451773:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637504 00000100:00100000:0.0:1787868920.451854:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787868920.451864:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1874715939637504:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787868920.451890:0:18597:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787868920.451939:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1874715939637504:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868920.451945:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787868920.452004:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f94000 x1874715939637504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868936 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868920.452033:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637504:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787868920.452042:0:17831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787868920.452068:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637632:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787868920.452111:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868920.452493:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868920.452559:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637632 00000100:00100000:3.0:1787868920.452564:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637632 00000100:00100000:3.0:1787868920.452606:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787868920.452615:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17831:x1874715939637632:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787868920.452646:0:18596:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1787868920.465655:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787868920.465671:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787868920.465966:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17831:x1874715939637632:12345-0@lo:5:osp-pre-0-1.0 Request processed in 13348us (13849us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787868920.465978:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787868920.466087:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0f840 x1874715939637632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868936 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868920.466099:0:17831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787868920.466107:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1874715939637632:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787868920.466124:0:17831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787868920.466203:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1874715939637760:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787868920.466241:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868920.466278:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044600 going to sleep for 11 seconds 00000100:00100000:1.0:1787868920.466422:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637760 00000100:00100000:1.0:1787868920.466429:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637760 00000100:00100000:1.0:1787868920.466471:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868920.466480:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1874715939637760:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787868920.466534:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1874715939637760:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868920.466540:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787868920.466711:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f97840 x1874715939637760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868936 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868920.466723:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1874715939637760:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787868920.740612:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868920.960692:0:19064:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868920.961288:0:19064:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787868921.634921:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868921.634956:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939637888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868921.635060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868921.635112:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939637888 00000100:00100000:0.0:1787868921.635124:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939637888 00000100:00100000:0.0:1787868921.635261:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787868921.635274:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939637888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868921.635338:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787868921.635401:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939637888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868921.635430:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868921.635517:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939638016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868921.635551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868921.639020:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638016 00000100:00100000:2.0:1787868921.639041:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638016 00000100:00100000:2.0:1787868921.639114:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787868921.639127:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939638016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868921.639210:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787868921.639408:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939638016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868921.639416:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939637888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868921.639421:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868921.639521:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939638016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787868921.761686:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787868922.276330:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868922.785496:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868923.815293:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868924.837743:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868925.538514:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868905/real 1787868905] req@ffff93d988a83c00 x1874715939628800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868925 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868925.538559:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a83c00 x1874715939628800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868925 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868925.538571:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868905/real 1787868905] req@ffff93d988a81e00 x1874715939628928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868925 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868925.538584:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d988a81e00 x1874715939628928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787868925 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868925.538611:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868925.538641:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868925.538646:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939628800:0@lo:8:kworker.0 00000100:00080000:0.0:1787868925.538653:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868925.538659:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787868925.538662:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939628928:0@lo:8:kworker.0 00000100:00080000:3.0:1787868925.538914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868925.538919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787868925.538923:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868925.538929:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1787868925.538935:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787868925.538943:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93dab7ed8000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868925.538982:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f95a40 x1874715939638400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868925.538996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868925.538999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787868925.539001:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868925.539003:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1787868925.539006:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787868925.539010:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868925.539021:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986f96940 x1874715939638528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868925.539051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868925.539054:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787868925.539056:0:8:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868925.539059:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:3.0:1787868925.539061:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787868925.539065:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868925.539075:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988190000 x1874715939639040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868925.539230:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939638784:0@lo:400:kworker.0 00000100:00100000:1.0:1787868925.539335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868925.539403:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939639424:0@lo:400:kworker.0 00000100:00100000:1.0:1787868925.539440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868925.539591:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638784 00000100:00100000:2.0:1787868925.539603:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638784 00000100:00100000:2.0:1787868925.539662:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787868925.539674:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868925.539742:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939638784:12345-0@lo:400:kworker.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868925.539751:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787868925.540481:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939638144:0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.540544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868925.540589:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939638912:0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.540620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868925.540676:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638144 00000100:00100000:0.0:1787868925.540683:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638144 00000100:00100000:0.0:1787868925.540726:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787868925.540735:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939638144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.540795:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939638144:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.540803:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787868925.540841:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638912 00000100:00100000:0.0:1787868925.540845:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638912 00000100:00100000:1.0:1787868925.544471:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939638784:0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.544738:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787868925.544755:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.544857:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939638912:12345-0@lo:400:kworker.0 Request processed in 109us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.544865:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787868925.545015:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868925.545041:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939638656:0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.545090:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939638144:0@lo:400:kworker.0 00000100:00100000:1.0:1787868925.547271:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939638400:0@lo:8:kworker.0 00000100:00100000:3.0:1787868925.550982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787868925.551330:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d988193840 x1874715939638912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868925.551355:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939638912:0@lo:400:kworker.0 00000100:00100000:3.0:1787868925.551542:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939639296:0@lo:400:kworker.0 00000100:00100000:3.0:1787868925.551589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868925.551727:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787868925.551736:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939638272:0@lo:400:kworker.0 00000100:00100000:3.0:1787868925.551784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868925.551811:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939639168:0@lo:400:kworker.0 00000100:00100000:3.0:1787868925.551834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868925.551943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868925.551984:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939638528:0@lo:8:kworker.0 00000100:00100000:1.0:1787868925.552013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868925.552032:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939639040:0@lo:8:kworker.0 00000100:00100000:1.0:1787868925.552080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868925.552128:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638400 00000100:00100000:1.0:1787868925.552137:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638400 00000100:00100000:1.0:1787868925.552195:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638528 00000100:00100000:1.0:1787868925.552199:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638528 00000100:00100000:1.0:1787868925.552208:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639040 00000100:00100000:1.0:1787868925.552210:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639040 00000100:00100000:1.0:1787868925.552236:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868925.552246:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939638400:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787868925.552297:0:18596:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:1.0:1787868925.552340:0:18596:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e40b 00002000:00100000:1.0:1787868925.552359:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d987e88800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787868925.552364:0:18596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787868925.552368:0:18596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787868925.552468:0:18596:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787868925.552505:0:18596:0:(import.c:65:import_set_state_nolock()) ffff93d987e8f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868925.552571:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939638400:12345-0@lo:8:kworker.0 Request processed in 323us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868925.552579:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868925.552598:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868925.552602:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939638528:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787868925.552615:0:18596:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868925.552657:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939638528:12345-0@lo:8:kworker.0 Request processed in 54us (643us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868925.552663:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868925.552674:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868925.552677:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939639040:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787868925.552686:0:18596:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868925.552709:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939639040:12345-0@lo:8:kworker.0 Request processed in 30us (629us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868925.552714:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787868925.552757:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986f95a40 x1874715939638400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868925.552769:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868925.552779:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787868925.552789:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787868925.552795:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787868925.552797:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787868925.552817:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787868925.552823:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939638400:0@lo:8:kworker.0 00000100:00080000:1.0:1787868925.552837:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868925.552841:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868925.552844:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939638528:0@lo:8:kworker.0 00000100:00080000:1.0:1787868925.552851:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868925.552854:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868925.552857:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939639040:0@lo:8:kworker.0 00000004:00080000:2.0:1787868925.553292:0:17113:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787868925.553318:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1874715939639680:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787868925.553361:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868925.553386:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868925.553402:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868925.553412:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868925.553440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868925.553469:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639552 00000100:00100000:2.0:1787868925.553474:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639552 00000100:00100000:2.0:1787868925.553527:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787868925.553535:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939639552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868925.553561:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787868925.553602:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939639552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868925.553609:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787868925.553629:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787868925.553654:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6e9a940 x1874715939639552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868925.553689:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868925.553712:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639680 00000100:00100000:2.0:1787868925.553716:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639680 00000100:00100000:2.0:1787868925.553741:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868925.553746:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1874715939639680:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787868925.556451:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639424 00000100:00100000:0.0:1787868925.556469:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639424 00000100:00100000:0.0:1787868925.556536:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638656 00000100:00100000:0.0:1787868925.556540:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638656 00000100:00100000:0.0:1787868925.556553:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639296 00000100:00100000:0.0:1787868925.556556:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639296 00000100:00100000:0.0:1787868925.556569:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639168 00000100:00100000:0.0:1787868925.556572:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639168 00000100:00100000:0.0:1787868925.556592:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868925.556602:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.556704:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939639424:12345-0@lo:400:kworker.0 Request processed in 103us (17261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.556726:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787868925.556747:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868925.556752:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.556790:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939638656:12345-0@lo:400:kworker.0 Request processed in 37us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.556796:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787868925.556809:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868925.556815:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939639296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.556844:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939639296:12345-0@lo:400:kworker.0 Request processed in 29us (5255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.556849:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787868925.556861:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787868925.556867:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939639168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868925.556895:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939639168:12345-0@lo:400:kworker.0 Request processed in 28us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868925.556901:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787868925.558117:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939638272 00000100:00100000:3.0:1787868925.558132:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939638272 00000100:00100000:3.0:1787868925.558210:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787868925.558232:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939638272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868925.558319:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939638272:12345-0@lo:400:kworker.0 Request processed in 100us (6533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868925.558327:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:3.0:1787868925.558363:0:17112:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787868925.558479:0:17112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 549684322536ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787868925.558487:0:17112:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787868925.558551:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939638272:0@lo:400:kworker.0 00010000:00080000:3.0:1787868925.558572:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d988192d00 x1874715939639168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868925.558584:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939639168:0@lo:400:kworker.0 00010000:00080000:3.0:1787868925.558599:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d988190b40 x1874715939638656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868925.558608:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939638656:0@lo:400:kworker.0 00010000:00080000:3.0:1787868925.558621:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9881921c0 x1874715939639296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868925.558630:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9881921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939639296:0@lo:400:kworker.0 00000100:00080000:1.0:1787868925.559754:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868925.559770:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787868925.559819:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d988190780 x1874715939639424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868925.559835:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939639424:0@lo:400:kworker.0 00000004:00080000:1.0:1787868925.565913:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787868925.568653:0:18596:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787868925.568681:0:18596:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787868925.568690:0:18596:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1787868925.586562:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.586579:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.586601:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.586606:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.586615:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.586638:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.586651:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.586659:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.586688:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.588184:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.588201:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.588227:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.588233:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.588245:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.588278:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.588287:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064816c8b/0x2f11f4d3bde2e412 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.588320:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.588322:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.588324:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.588738:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.588756:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.588772:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.588777:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.588785:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.588799:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.588810:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.588819:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.588849:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.588926:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.588932:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589131:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.589134:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589151:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589207:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589225:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cf90461/0x2f11f4d3bde2e419 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589245:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.589247:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.589248:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.589408:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.589414:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589423:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.589426:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.589431:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589441:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589457:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589464:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589490:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.589507:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.589513:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589522:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.589525:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589533:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589545:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589564:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b2a760/0x2f11f4d3bde2e420 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.589579:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.589581:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.589583:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.589945:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.589952:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589961:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.589964:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.589968:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589978:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589986:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.589994:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590028:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.590065:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.590071:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590080:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.590084:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590092:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590105:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590113:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035965e5b/0x2f11f4d3bde2e427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590131:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.590133:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.590134:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.590453:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.590460:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590468:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.590471:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.590476:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590485:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590494:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590501:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590528:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.590563:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.590568:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590576:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.590579:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590587:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590600:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590608:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e67b60/0x2f11f4d3bde2e42e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590624:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.590626:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.590627:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.590870:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.590876:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590885:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.590894:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.590899:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590908:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590916:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590924:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.590945:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.590970:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.590975:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.590983:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80030a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.590986:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591006:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591018:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591026:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8b131ef/0x2f11f4d3bde2e435 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591042:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.591043:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.591045:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.591396:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.591402:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.591411:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.591415:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.591419:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.591428:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.591436:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.591450:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.591472:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.591557:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.591563:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591572:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.591576:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591583:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591597:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591615:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aee2f29/0x2f11f4d3bde2e43c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.591633:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.591634:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.591636:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.593633:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.593715:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.593740:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.593745:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.593753:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.593772:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.593782:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.593790:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.593818:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.593955:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.593964:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.593973:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.593978:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.593988:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.594010:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.594019:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2e443 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.594041:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.594043:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.594045:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.594772:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.594784:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.594804:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.594807:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.594813:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.594825:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.594834:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.594841:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.595095:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.595674:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.595684:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.595695:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.595701:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.595709:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.595731:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.595738:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e44a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.595758:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.595759:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.595761:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.598071:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.598091:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.598113:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.598119:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.598126:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.598143:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.598501:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.598509:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.599843:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787868925.600572:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.600583:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.600605:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.600610:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.600617:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.600634:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.600644:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.600652:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.600870:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868925.600881:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.600890:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.600896:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.600998:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601022:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601030:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f972e23/0x2f11f4d3bde2e451 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601049:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.601053:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601060:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.601063:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601072:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601081:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.601089:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.601091:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.601099:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868925.601238:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868925.601244:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b852206/0x2f11f4d3bde2e458 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868925.602076:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.602087:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.602102:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.602106:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.602114:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.602127:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.602137:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.602144:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.603084:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.603098:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.603111:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.603116:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.603126:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.603147:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.603191:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.603192:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.603194:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868925.603498:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868925.603507:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e45f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868925.604285:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.604296:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.604320:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.604327:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.604336:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.604353:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.604364:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.604373:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.605359:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.605372:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.605383:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.605388:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.605398:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.605441:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.605450:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.605452:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.605454:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868925.606200:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868925.606211:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e466 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787868925.607140:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787868925.607170:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.607187:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1787868925.607192:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868925.607200:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.607243:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.607255:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.607263:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.607280:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.609304:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.609319:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.609334:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.609340:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.609352:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.609378:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.609386:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdd4368/0x2f11f4d3bde2e46d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.609405:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.609407:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.609409:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.609425:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.609844:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.609855:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.609871:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.609877:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.609886:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.609902:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.609913:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.609922:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.609950:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868925.610391:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.610398:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.610407:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.610412:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.610421:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.610437:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.610445:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427d575b/0x2f11f4d3bde2e474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.610464:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.610466:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.610468:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.610835:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.610842:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.610866:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.610870:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.610876:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.610887:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.610895:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.610902:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.610920:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787868925.611605:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.611614:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.611626:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.611629:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.611634:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.611645:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611648:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.611656:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611665:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868925.611667:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611669:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.611676:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611678:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611697:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.611698:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868925.611705:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fe54641/0x2f11f4d3bde2e47b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611732:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.611735:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611742:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.611745:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611753:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611764:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611771:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6880ae/0x2f11f4d3bde2e482 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.611782:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.611784:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.611786:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.612068:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.613466:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.613481:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.613501:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.613505:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.613515:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.613531:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.613543:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.613551:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.613595:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868925.613688:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.613696:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.613704:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.613715:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.613725:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.613745:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.613752:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e489 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.613774:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.613776:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.613778:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.614281:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.614290:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.614302:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.614306:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.617272:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.617322:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.617336:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.617345:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.617379:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868925.617441:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.617452:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.617461:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.617465:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.617475:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.617496:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.617524:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e490 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.617551:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.617553:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.617555:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.618289:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.618300:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618331:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.618345:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.618353:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618365:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618373:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618381:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618406:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868925.618754:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.618762:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.618771:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.618776:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.618784:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.618802:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.618809:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e497 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.618828:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.618830:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.618831:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.618859:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.618865:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618875:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.618878:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.618883:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618892:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618901:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618914:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.618936:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868925.619209:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.619225:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.619234:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.619238:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.619246:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.619259:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.619266:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e49e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.619281:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.619283:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.619284:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.619298:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.619304:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619325:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.619328:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.619332:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619341:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619349:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619357:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619375:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787868925.619788:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.619795:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619810:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.619814:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.619818:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619828:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619835:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619842:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.619866:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787868925.620133:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.620139:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620147:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.620150:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.620268:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620281:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620299:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620306:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620382:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787868925.620647:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787868925.620657:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620666:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.620671:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620688:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620689:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868925.620696:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620703:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.620706:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620708:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620717:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ed52b7/0x2f11f4d3bde2e4a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620726:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620736:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620743:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ab1c59c/0x2f11f4d3bde2e4ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620744:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.620748:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620755:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.620758:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620758:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.620759:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.620762:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.620766:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.620770:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.620775:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620781:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbf86d78/0x2f11f4d3bde2e4b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.620807:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.620809:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.620812:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868925.620907:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.620914:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620924:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.620928:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.620933:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620944:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620952:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620960:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.620995:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787868925.622519:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868925.622533:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.622552:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787868925.622556:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868925.622564:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.622578:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.622588:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.622596:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868925.623018:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787868925.625029:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.625045:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.625084:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.625088:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.625097:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.625114:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.625127:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.625136:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627410:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787868925.627431:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627447:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.627453:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627465:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627493:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627503:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4320dad/0x2f11f4d3bde2e4ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627581:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868925.627586:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627592:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.627608:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627615:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627627:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627635:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e4c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627654:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868925.627659:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627665:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868925.627668:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627676:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627686:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.627693:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.627703:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868925.627705:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.628343:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868925.629528:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868925.629544:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009426807b/0x2f11f4d3bde2e4c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868925.630095:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868925.630610:0:18596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868925.630621:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.630639:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787868925.630645:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868925.630654:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.630686:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.630698:0:18596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.630707:0:18596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868925.630733:0:18596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787868925.630788:0:18596:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1787868925.630927:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1874715939639680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77174us (77559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868925.630942:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868925.631020:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1874715939639680:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787868925.631041:0:17113:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787868925.631101:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1874715939639808:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787868925.631148:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868925.631287:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa0f403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868925.631380:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639808 00000100:00100000:2.0:1787868925.631389:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639808 00000100:00100000:2.0:1787868925.631439:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787868925.631450:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17113:x1874715939639808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787868925.631500:0:18597:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1787868925.634963:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868925.634984:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.635002:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868925.635009:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.635023:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.635054:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.635082:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e4cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868925.635110:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.635112:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868925.635113:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787868925.650231:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787868925.650300:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787868925.650805:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17113:x1874715939639808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19349us (19650us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787868925.650826:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868925.651281:0:17113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787868925.651294:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1874715939639808:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787868925.651385:0:17113:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1787868925.742742:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868925.742778:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939639936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868925.742874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868925.742944:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939639936 00000100:00100000:3.0:1787868925.742954:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939639936 00000100:00100000:3.0:1787868925.743015:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868925.743025:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939639936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868925.743057:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787868925.743110:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939639936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868925.743119:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868925.743209:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939639936:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787868925.857339:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868926.753339:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939640064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868926.753428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868926.753479:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640064 00000100:00100000:0.0:1787868926.753486:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640064 00000100:00100000:0.0:1787868926.753542:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787868926.753553:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939640064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868926.753589:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787868926.753640:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939640064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868926.753648:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787868926.753695:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939640064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868926.753826:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939640192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868926.753875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868926.753900:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640192 00000100:00100000:1.0:1787868926.753906:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640192 00000100:00100000:1.0:1787868926.753931:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868926.753939:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939640192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868926.754042:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787868926.754190:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939640192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868926.754218:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787868926.761608:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939640192:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787868926.884126:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787868927.586137:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787868927.905518:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787868928.466829:0:19409:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787868928.466834:0:19409:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787868928.466835:0:19409:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787868928.466941:0:19409:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d9871e8000 00000020:01000004:2.0:1787868928.466956:0:19409:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787868928.466969:0:19409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787868928.466982:0:19409:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93dabd2fced8) 00000020:00000080:2.0:1787868928.467000:0:19409:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787868928.525070:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787868928.527848:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787868928.528369:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787868928.528603:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787868928.528768:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787868928.528988:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787868928.529184:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1787868928.531426:0:19409:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787868928.531662:0:19409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787868928.531677:0:19409:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787868928.531691:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2e4dd 00000020:01000004:1.0:1787868928.531699:0:19409:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787868928.531724:0:19409:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787868928.531728:0:19409:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787868928.531734:0:19409:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787868928.531763:0:19409:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787868928.531767:0:19409:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787868928.542364:0:19409:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787868928.542416:0:19409:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787868928.542421:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787868928.542423:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787868928.542424:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868928.542425:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868928.542426:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868928.542428:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868928.542429:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868928.542431:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868928.542432:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868928.542441:0:19409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787868928.542443:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787868928.542445:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787868928.542445:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868928.542446:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868928.542447:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868928.542448:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868928.542449:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868928.542451:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868928.542451:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787868928.542477:0:19409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787868928.542497:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787868928.542570:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.542671:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787868928.542802:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640320 00000100:00100000:3.0:1787868928.542812:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640320 00000100:00100000:3.0:1787868928.542916:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787868928.542927:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:19409:x1874715939640320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787868928.542964:0:17083:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787868928.542968:0:17083:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787868928.542971:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787868928.543870:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:19409:x1874715939640320:12345-0@lo:253:mount.lustre.0 Request processed in 943us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868928.543879:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787868928.543957:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787868928.543968:0:19409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787868928.543971:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787868928.543972:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787868928.543973:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787868928.543974:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787868928.543975:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787868928.543977:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787868928.543978:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787868928.543979:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787868928.543980:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787868928.544003:0:19409:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d9871e8000 from lustre-OST0001 10000000:01000000:1.0:1787868928.544030:0:19409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787868928.544033:0:19409:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787868928.544042:0:19409:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd849a48 local copy 00010000:00010000:1.0:1787868928.544053:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.544141:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868928.544205:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.544454:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.544489:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640448 00000100:00100000:0.0:1787868928.544495:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640448 00000100:00100000:0.0:1787868928.544580:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787868928.544590:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:19409:x1874715939640448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868928.544671:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:19409:x1874715939640448:12345-0@lo:501:mount.lustre.0 Request processed in 83us (465us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787868928.544688:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787868928.544746:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787868928.544759:0:19409:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787868928.544777:0:19409:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787868928.544783:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.544792:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868928.544822:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d9871e8000 10000000:01000000:1.0:1787868928.544827:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787868928.544833:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787868928.544836:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787868928.544842:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787868928.544845:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787868928.544870:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.544878:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.544887:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.544902:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787868928.544930:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.545028:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.545122:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640576 00000100:00100000:2.0:1787868928.545128:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640576 00000100:00100000:2.0:1787868928.545152:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787868928.545192:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+21:19409:x1874715939640576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868928.545200:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868928.545226:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2e4eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e4e4 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.545252:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2e4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e4e4 expref: 22 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.545271:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2e4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e4e4 expref: 22 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.545279:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871800, rc 0) 00000100:00100000:2.0:1787868928.545316:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640576:12345-0@lo:101:mount.lustre.0 Request processed in 127us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.545332:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787868928.545663:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787868928.545684:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.545694:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787868928.546898:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787868928.547714:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787868928.549950:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787868928.550003:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787868928.550017:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787868928.550028:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787868928.550038:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787868928.550048:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787868928.550083:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787868928.550089:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787868928.550410:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868928.550525:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.550636:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.550686:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640704 00000100:00100000:2.0:1787868928.550694:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640704 00000100:00100000:2.0:1787868928.550793:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787868928.550804:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868928.550975:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640704:12345-0@lo:501:mount.lustre.0 Request processed in 173us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.550983:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787868928.551060:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868928.551094:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787868928.551135:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.551293:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.551517:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640832 00000100:00100000:0.0:1787868928.551522:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640832 00000100:00100000:0.0:1787868928.551547:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787868928.551554:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868928.552499:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640832:12345-0@lo:503:mount.lustre.0 Request processed in 942us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.552508:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787868928.552623:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787868928.553052:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787868928.553131:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868928.553386:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.553425:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.553505:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939640960 00000100:00100000:0.0:1787868928.553510:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939640960 00000100:00100000:0.0:1787868928.553538:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787868928.553546:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.553881:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939640960:12345-0@lo:502:mount.lustre.0 Request processed in 334us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.553888:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787868928.554108:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939640960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868928.554493:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787868928.554525:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787868928.554543:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787868928.554557:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787868928.554571:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787868928.554585:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787868928.554601:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787868928.554615:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787868928.554630:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787868928.554657:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868928.554700:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.554722:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.554779:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641088 00000100:00100000:0.0:1787868928.554784:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641088 00000100:00100000:0.0:1787868928.554823:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787868928.554832:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939641088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.554924:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939641088:12345-0@lo:502:mount.lustre.0 Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.554931:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787868928.555058:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787868928.555101:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787868928.555110:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787868928.556053:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787868928.556062:0:19413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787868928.556069:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.556071:0:19413:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787868928.556077:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787868928.556093:0:19413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d986e4b490) 00000020:00000080:1.0:1787868928.556120:0:19413:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787868928.556125:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787868928.557856:0:19413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9871e8000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787868928.557871:0:19413:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787868928.557883:0:19413:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2e4f9 00010000:00010000:1.0:1787868928.562993:0:19413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787868928.563799:0:19413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787868928.565740:0:19413:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787868928.567433:0:19413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787868928.567445:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868928.567452:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.567454:0:19413:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787868928.567458:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868928.567462:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.567463:0:19413:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787868928.567465:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787868928.567467:0:19413:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787868928.567469:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868928.567471:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.567472:0:19413:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787868928.567475:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787868928.567477:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.567478:0:19413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787868928.567481:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787868928.567507:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787868928.567509:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787868928.567511:0:19413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787868928.567514:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787868928.567804:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787868928.567835:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787868928.567857:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868928.567870:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868928.567877:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9871e8000 from 1 10000000:01000000:3.0:1787868928.567880:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868928.567917:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868928.567925:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868928.567935:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868928.567959:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787868928.568026:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.568119:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93104900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.574478:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641216 00000100:00100000:0.0:1787868928.574493:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641216 00000100:00100000:0.0:1787868928.574592:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787868928.574605:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:19409:x1874715939641216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868928.574629:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868928.574649:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e500 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.574678:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.574690:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.574698:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286600, rc 0) 00000100:00100000:0.0:1787868928.574779:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641216:12345-0@lo:101:mount.lustre.0 Request processed in 177us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.574787:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787868928.574948:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787868928.574972:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868928.574982:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868928.577670:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787868928.577995:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787868928.578526:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787868928.578556:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787868928.578575:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787868928.578579:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787868928.578673:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868928.578748:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.578952:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93104d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.579029:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641344 00000100:00100000:2.0:1787868928.579036:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641344 00000100:00100000:2.0:1787868928.579082:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787868928.579091:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787868928.579269:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641344:12345-0@lo:501:mount.lustre.0 Request processed in 179us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.579278:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787868928.579998:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787868928.580040:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787868928.580095:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.580121:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93104d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.580419:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641472 00000100:00100000:2.0:1787868928.580425:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641472 00000100:00100000:2.0:1787868928.580452:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787868928.580458:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787868928.580881:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641472:12345-0@lo:503:mount.lustre.0 Request processed in 421us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.580889:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787868928.584702:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787868928.585151:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787868928.585628:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868928.585700:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.585790:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93104900 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.585834:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641600 00000100:00100000:0.0:1787868928.585841:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641600 00000100:00100000:0.0:1787868928.585918:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787868928.585929:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.586056:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641600:12345-0@lo:502:mount.lustre.0 Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.586064:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787868928.586141:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787868928.586393:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787868928.586428:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787868928.586444:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787868928.586457:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787868928.586470:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787868928.586483:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787868928.586497:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787868928.586510:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787868928.586521:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787868928.586533:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787868928.586557:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787868928.586579:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787868928.586616:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.587450:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93104900 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.587567:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641728 00000100:00100000:2.0:1787868928.587575:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641728 00000100:00100000:2.0:1787868928.587616:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787868928.587623:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787868928.587757:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641728:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.587765:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787868928.587857:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787868928.587914:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787868928.587925:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787868928.588870:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868928.588883:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.588886:0:19417:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787868928.588893:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9871e8000 00000020:00000080:3.0:1787868928.588895:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868928.588905:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868928.588907:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.588909:0:19417:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787868928.588911:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868928.588913:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.588915:0:19417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787868928.588918:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9871e8000 00000020:00000080:3.0:1787868928.588920:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868928.589004:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868928.589007:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.589018:0:19417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787868928.589021:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868928.589023:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.589025:0:19417:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868928.589028:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d9871e8000 00000020:00000080:3.0:1787868928.589030:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868928.592426:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868928.592442:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.592444:0:19417:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787868928.592448:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787868928.592452:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.592454:0:19417:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787868928.592458:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d9871e8000 00000020:00000080:3.0:1787868928.592460:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787868928.592522:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787868928.592525:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787868928.592526:0:19417:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787868928.592529:0:19417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787868928.592893:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787868928.592922:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868928.592947:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.592961:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868928.593038:0:19409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787868928.593041:0:19409:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d9871e8000 10000000:01000000:0.0:1787868928.593044:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d9871e8000 10000000:01000000:0.0:1787868928.593048:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787868928.593053:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d9871e8000 from 1 10000000:01000000:0.0:1787868928.593056:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787868928.593093:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.593102:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.593113:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868928.593138:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787868928.597548:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.597607:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878600 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.597717:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641856 00000100:00100000:2.0:1787868928.597727:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641856 00000100:00100000:2.0:1787868928.597777:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787868928.597786:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:19409:x1874715939641856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787868928.597803:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868928.597821:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2e515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e50e expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.597855:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e50e expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.597868:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e50e expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.597878:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870000, rc 0) 00000100:00100000:2.0:1787868928.597928:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939641856:12345-0@lo:101:mount.lustre.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.597935:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787868928.599942:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787868928.599968:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.599980:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787868928.603544:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787868928.603836:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787868928.604060:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787868928.604096:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787868928.604128:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787868928.604144:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787868928.604195:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787868928.606001:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787868928.606071:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787868928.606089:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787868928.606104:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787868928.606118:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787868928.606135:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787868928.606150:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787868928.606198:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787868928.608061:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787868928.608112:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787868928.608128:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787868928.608144:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787868928.608186:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787868928.608227:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787868928.608245:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787868928.608405:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787868928.608423:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787868928.608439:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787868928.608455:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787868928.608469:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787868928.608483:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787868928.608498:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787868928.608512:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787868928.608527:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787868928.608541:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787868928.608556:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787868928.608570:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787868928.608584:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787868928.608597:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787868928.608628:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787868928.608644:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787868928.608657:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787868928.608671:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787868928.608684:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787868928.608697:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787868928.608708:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787868928.608720:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787868928.608734:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787868928.608749:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787868928.608761:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787868928.608773:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787868928.608803:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787868928.608809:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787868928.608928:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868928.608992:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.609041:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878180 going to sleep for 11 seconds 00000100:00100000:1.0:1787868928.613673:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939641984 00000100:00100000:1.0:1787868928.613689:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939641984 00000100:00100000:1.0:1787868928.613746:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787868928.613758:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939641984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787868928.613945:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939641984:12345-0@lo:501:mount.lustre.0 Request processed in 189us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.613953:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787868928.615510:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939641984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787868928.615579:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868928.615647:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.615691:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878180 going to sleep for 11 seconds 00000100:00100000:0.0:1787868928.615810:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642112 00000100:00100000:0.0:1787868928.615816:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642112 00000100:00100000:0.0:1787868928.615872:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787868928.615881:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787868928.615989:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642112:12345-0@lo:503:mount.lustre.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868928.615997:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787868928.616049:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787868928.616779:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787868928.616857:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.616906:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.616946:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878600 going to sleep for 11 seconds 00000100:00100000:1.0:1787868928.617627:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642240 00000100:00100000:1.0:1787868928.617636:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642240 00000100:00100000:1.0:1787868928.617683:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787868928.617693:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868928.617822:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642240:12345-0@lo:502:mount.lustre.0 Request processed in 130us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.617830:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787868928.619480:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787868928.619739:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787868928.619787:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787868928.619805:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787868928.619818:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787868928.619829:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787868928.619840:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787868928.619851:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787868928.619863:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787868928.619874:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787868928.619885:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787868928.619896:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787868928.619908:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787868928.619919:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787868928.619930:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787868928.619941:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787868928.619952:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787868928.619963:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787868928.619987:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787868928.620000:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787868928.620011:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787868928.620023:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787868928.620034:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787868928.620045:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787868928.620057:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787868928.620078:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787868928.620090:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787868928.620101:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787868928.620112:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787868928.620125:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787868928.620138:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787868928.620150:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787868928.620199:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787868928.620228:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787868928.622622:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787868928.622678:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787868928.622694:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787868928.622708:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787868928.622723:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787868928.622736:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787868928.622749:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787868928.622762:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787868928.622774:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787868928.622786:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787868928.622800:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787868928.622814:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787868928.622829:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787868928.622844:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787868928.622857:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787868928.622938:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.623038:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.623097:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878600 going to sleep for 11 seconds 00000100:00100000:1.0:1787868928.624368:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642368 00000100:00100000:1.0:1787868928.624379:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642368 00000100:00100000:1.0:1787868928.624438:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787868928.624448:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868928.624588:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642368:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.624597:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787868928.625493:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787868928.627050:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787868928.627100:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787868928.627144:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787868928.627433:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.631473:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878600 going to sleep for 11 seconds 00000100:00100000:1.0:1787868928.633799:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642496 00000100:00100000:1.0:1787868928.633814:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642496 00000100:00100000:1.0:1787868928.633880:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787868928.633893:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787868928.634081:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939642496:12345-0@lo:502:mount.lustre.0 Request processed in 191us (6648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.634090:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787868928.634511:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939642496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787868928.634602:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787868928.634618:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787868928.635989:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787868928.636006:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93dabc0b8000) 00000020:00000080:1.0:1787868928.636537:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787868928.636643:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9871e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787868928.636647:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9871e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787868928.636650:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9871e8000 3 00010000:00080000:1.0:1787868928.636683:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d987e8b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787868928.638284:0:19422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787868928.638490:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787868928.638531:0:19422:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787868928.638550:0:19422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2f11f4d3bde2e523 00000100:00080000:1.0:1787868928.638562:0:19422:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868928.638568:0:19422:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d987e8b000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868928.638612:0:19422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f0c3c0 x1874715939642624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868928.638648:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939642624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787868928.638721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.638793:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642624 00000100:00100000:1.0:1787868928.638801:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642624 00000100:00100000:1.0:1787868928.638833:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787868928.638840:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939642624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787868928.638866:0:17089:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1787868928.638896:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2e52a 00000004:00100000:1.0:1787868928.638911:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787868928.638999:0:17089:0:(import.c:65:import_set_state_nolock()) ffff93d981c08800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868928.639075:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874715939642624:12345-0@lo:38:llog_process_th.0 Request processed in 233us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.639085:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787868928.639125:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0c3c0 x1874715939642624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868928.639136:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868928.639144:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787868928.639151:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787868928.641504:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787868928.641509:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787868928.641522:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939642624:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787868928.641565:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787868928.641899:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939642752:0@lo:400:kworker.0 00000100:00100000:0.0:1787868928.641962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787868928.642040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868928.642044:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787868928.642047:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868928.642052:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1787868928.642056:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787868928.642061:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868928.642081:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9882db0c0 x1874715939643008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868928.642148:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642752 00000100:00100000:1.0:1787868928.642182:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642752 00000100:00100000:1.0:1787868928.642239:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868928.642249:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939642752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787868928.642721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787868928.642725:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787868928.642727:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868928.642732:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1787868928.642740:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787868928.642744:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868928.642759:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9882d8780 x1874715939643520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868928.642815:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939643264:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.642849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.642863:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939643904:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.642887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.642910:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868928.642916:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939643392:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.642941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.642966:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939642880:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.642989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.643013:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939643648:0@lo:400:kworker.0 00000100:00100000:2.0:1787868928.643018:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643392 00000100:00100000:2.0:1787868928.643023:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643392 00000100:00100000:3.0:1787868928.643033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868928.643049:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787868928.643054:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939643136:0@lo:400:kworker.0 00000100:00100000:2.0:1787868928.643062:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939642880 00000100:00100000:2.0:1787868928.643065:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939642880 00000100:00100000:3.0:1787868928.643074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868928.643086:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787868928.643088:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939643776:0@lo:400:kworker.0 00000100:00100000:2.0:1787868928.643093:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.643108:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868928.643148:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939643392:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643179:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939642752:12345-0@lo:400:kworker.0 Request processed in 906us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643188:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868928.643205:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643264 00000100:00100000:1.0:1787868928.643208:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643264 00000100:00100000:1.0:1787868928.643240:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868928.643246:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939643264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868928.643455:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939643264:12345-0@lo:400:kworker.0 Request processed in 209us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643462:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868928.643484:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939643008:0@lo:8:kworker.0 00000100:00100000:1.0:1787868928.643511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.643523:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939643520:0@lo:8:kworker.0 00000100:00100000:2.0:1787868928.643532:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787868928.643543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868928.643547:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643008 00000100:00100000:2.0:1787868928.643550:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643008 00000100:00100000:2.0:1787868928.643560:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643520 00000100:00100000:2.0:1787868928.643562:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643520 00000100:00100000:1.0:1787868928.643571:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643904 00000100:00100000:2.0:1787868928.643572:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868928.643573:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643904 00000100:00100000:2.0:1787868928.643578:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939642880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868928.643592:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643648 00000100:00100000:1.0:1787868928.643595:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643648 00000100:00100000:1.0:1787868928.643606:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643136 00000100:00100000:1.0:1787868928.643609:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643136 00000100:00100000:2.0:1787868928.643614:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939642880:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643619:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939643776 00000100:00100000:2.0:1787868928.643621:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787868928.643621:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939643776 00000100:00100000:2.0:1787868928.643631:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787868928.643634:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868928.643635:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939643008:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787868928.643646:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939643904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868928.643675:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939643904:12345-0@lo:400:kworker.0 Request processed in 30us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.643677:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939643008:12345-0@lo:8:kworker.0 Request processed in 41us (166us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787868928.643681:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787868928.643683:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787868928.643693:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868928.643693:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787868928.643697:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939643520:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787868928.643699:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939643648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868928.643723:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939643648:12345-0@lo:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643729:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787868928.643740:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787868928.643746:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939643136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868928.643771:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939643136:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643776:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787868928.643786:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787868928.643792:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939643776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868928.643801:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939643520:12345-0@lo:8:kworker.0 Request processed in 25us (179us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787868928.643809:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868928.643833:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939643776:12345-0@lo:400:kworker.0 Request processed in 41us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.643839:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787868928.643854:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868928.643858:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868928.643860:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868928.643885:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868928.643892:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868928.643896:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787868928.643900:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939643008:0@lo:8:kworker.0 00000100:00100000:1.0:1787868928.643915:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787868928.643918:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868928.643921:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787868928.643923:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939643520:0@lo:8:kworker.0 00000100:00100000:3.0:1787868928.644583:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939643392:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.644595:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939643264:0@lo:400:kworker.0 00010000:00080000:3.0:1787868928.644607:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9882d9e00 x1874715939643904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868928.644630:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939643904:0@lo:400:kworker.0 00010000:00080000:3.0:1787868928.644662:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9882d8000 x1874715939643136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868928.644671:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939643136:0@lo:400:kworker.0 00010000:00080000:3.0:1787868928.644679:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9882db480 x1874715939643776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868928.644686:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939643776:0@lo:400:kworker.0 00000100:00100000:3.0:1787868928.644696:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939642880:0@lo:400:kworker.0 00010000:00080000:3.0:1787868928.644704:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9882d92c0 x1874715939643648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868928.644711:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939643648:0@lo:400:kworker.0 00000020:01000004:1.0:1787868928.644905:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787868928.644920:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93dabc0b9a48) 00000020:00000080:1.0:1787868928.644940:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787868928.645016:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9871e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787868928.645020:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9871e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787868928.645023:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9871e8000 3 00010000:00080000:1.0:1787868928.645050:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d981c0c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:0.0:1787868928.646071:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939642752:0@lo:400:kworker.0 00010000:00010000:1.0:1787868928.647025:0:19422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787868928.647525:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787868928.647570:0:19422:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787868928.647582:0:19422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2f11f4d3bde2e538 00000100:00080000:1.0:1787868928.647591:0:19422:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787868928.647597:0:19422:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d981c0c000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868928.647629:0:19422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f0de00 x1874715939644032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868928.647696:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939644032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787868928.647762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.647845:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644032 00000100:00100000:1.0:1787868928.647852:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644032 00000100:00100000:1.0:1787868928.647885:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868928.647892:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939644032:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787868928.647919:0:17089:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1787868928.647951:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2e53f 00000004:00100000:1.0:1787868928.647966:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787868928.647995:0:17089:0:(import.c:65:import_set_state_nolock()) ffff93d981c0f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868928.648095:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874715939644032:12345-0@lo:38:llog_process_th.0 Request processed in 201us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.648103:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787868928.648125:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1787868928.648727:0:19422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:0.0:1787868928.648885:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f0de00 x1874715939644032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787868938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868928.648897:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787868928.648905:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787868928.648913:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787868928.648917:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787868928.648920:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d981c0c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787868928.648926:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939644032:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787868928.648955:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787868928.648987:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787868928.649007:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868928.649018:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787868928.649086:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787868928.649088:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868928.649090:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868928.649091:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868928.649093:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868928.649094:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868928.649097:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868928.649099:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868928.649100:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868928.649104:0:19409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787868928.649106:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787868928.649108:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868928.649109:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868928.649110:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868928.649111:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868928.649113:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868928.649114:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868928.649115:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868928.649116:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787868928.649134:0:19409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787868928.649150:0:19409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939644160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787868928.649243:0:19409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.649743:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644160 00000100:00100000:0.0:1787868928.649750:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644160 00000100:00100000:0.0:1787868928.649800:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787868928.649809:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939644160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787868928.649833:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787868928.649847:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787868928.649969:0:19409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878cc0 going to sleep for 11 seconds 20000000:01000000:2.0:1787868928.655541:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787868928.655563:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787868928.655931:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:19409:x1874715939644160:12345-0@lo:253:mount.lustre.0 Request processed in 6118us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.655944:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787868928.656057:0:19409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:431a2c34-804b-46dd-9d1f-913354b6c612:19409:1874715939644160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787868928.656072:0:19409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787868928.656076:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787868928.656088:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787868928.656090:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787868928.656091:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787868928.656092:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787868928.656093:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787868928.656095:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787868928.656097:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787868928.656098:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787868928.656115:0:19409:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787868928.660108:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787868928.660122:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787868928.660190:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660221:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660230:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660238:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660407:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660424:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.660440:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939644288:0@lo:104: 00000100:00100000:1.0:1787868928.660512:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787868928.660618:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.660627:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.660654:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939644416:0@lo:104: 00000100:00100000:1.0:1787868928.660681:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.667414:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98805f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787868928.672092:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644288 00000100:00100000:2.0:1787868928.672105:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644288 00000100:00100000:2.0:1787868928.672186:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644416 00000100:00100000:2.0:1787868928.672190:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644416 00000100:00100000:2.0:1787868928.672223:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868928.672234:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939644288:12345-0@lo:104: 00010000:00010000:2.0:1787868928.672383:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672492:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868928.672498:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+4:17104:x1874715939644288:12345-0@lo:104: Request processed in 267us (11987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.672507:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787868928.672528:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787868928.672535:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939644416:12345-0@lo:104: 00010000:00010000:2.0:1787868928.672544:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672581:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787868928.672586:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:17104:x1874715939644416:12345-0@lo:104: Request processed in 53us (11906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868928.672592:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787868928.672608:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868928.672614:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672621:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868928.672625:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672634:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868928.672648:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868928.672653:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868928.672691:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672698:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868928.672718:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672725:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287a00/0x2f11f4d3bde2e3f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3fd expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672736:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868928.672738:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672743:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868928.672746:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672752:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868928.672758:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868928.672763:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787868928.672783:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672790:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868928.672806:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672812:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987286000/0x2f11f4d3bde2e3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3ef expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.672828:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868928.672830:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868928.672833:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868928.672848:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939644544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868928.672885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868928.673012:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939644288:0@lo:104: 00000100:00100000:0.0:1787868928.673022:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1874715939644416:0@lo:104: 00010000:00010000:0.0:1787868928.673042:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868928.673363:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868928.673542:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644544 00000100:00100000:1.0:1787868928.673548:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644544 00010000:00010000:1.0:1787868928.673576:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 24 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.673610:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868928.673619:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939644544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868928.673629:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868928.673634:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 24 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.673647:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 24 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.673662:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb0400/0x2f11f4d3bde2e3fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3f6 expref: 24 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.673675:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868928.673732:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+23:3639:x1874715939644544:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.673739:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868928.673769:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939644544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868928.674059:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939644672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868928.674096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868928.674133:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644672 00000100:00100000:1.0:1787868928.674137:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644672 00010000:00010000:1.0:1787868928.674203:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868928.674239:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868928.674246:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+23:3636:x1874715939644672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868928.674265:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868928.674270:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674279:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674294:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828d800/0x2f11f4d3bde2e3ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e3e8 expref: 23 pid: 17082 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674310:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674318:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787868928.674332:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014211336s 00010000:00010000:1.0:1787868928.674337:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674344:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674351:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674358:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674370:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2070600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868928.674375:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674383:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674397:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674406:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868928.674434:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+22:3636:x1874715939644672:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868928.674441:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787868928.674466:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674474:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868928.674480:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e546 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787868928.676120:0:19409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787868928.678877:0:19409:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787868928.678888:0:19409:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787868928.678929:0:19409:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787868928.678980:0:19409:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787868928.679007:0:19409:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787868928.679041:0:19409:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787868928.680151:0:19409:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787868928.682023:0:19409:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787868928.687718:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939644672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868928.929513:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868929.954009:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868929.963324:0:19475:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868929.965364:0:19475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787868930.530569:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787868930.530578:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab7ec9800 from 10 10000000:01000000:3.0:1787868930.530584:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787868930.530637:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.530650:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.530674:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868930.530707:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939644800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868930.530804:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868930.530849:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868930.531182:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644800 00000100:00100000:1.0:1787868930.531190:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644800 00000100:00100000:1.0:1787868930.531245:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787868930.531254:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939644800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868930.531268:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868930.531282:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2e554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e54d expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868930.531306:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2e554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e54d expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868930.531317:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2e554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e54d expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868930.531326:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2070e00, rc 0) 00000100:00100000:1.0:1787868930.531376:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939644800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868930.531383:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787868930.531561:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939644800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868930.531577:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.531585:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868930.531638:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939644928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787868930.531670:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868930.531703:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868930.531741:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939644928 00000100:00100000:0.0:1787868930.531746:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939644928 00000100:00100000:0.0:1787868930.531793:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868930.531802:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939644928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787868930.531817:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787868930.531835:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787868930.531838:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787868930.531926:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939644928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868930.531933:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787868930.532139:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939644928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787868930.532229:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868930.532237:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.532244:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868930.532253:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787868930.532255:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93daa05e9800 from 10 10000000:01000000:3.0:1787868930.532264:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787868930.532286:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.532293:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.532301:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868930.532313:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939645056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868930.532339:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868930.532355:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868930.532475:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645056 00000100:00100000:0.0:1787868930.532479:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645056 00000100:00100000:0.0:1787868930.532514:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787868930.532521:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939645056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868930.532536:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868930.532548:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287600/0x2f11f4d3bde2e562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e55b expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868930.532564:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287600/0x2f11f4d3bde2e562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e55b expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868930.532574:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287600/0x2f11f4d3bde2e562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e55b expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868930.532580:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287600, rc 0) 00000100:00100000:0.0:1787868930.532616:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939645056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868930.532622:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787868930.532754:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939645056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868930.532765:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.532773:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868930.532822:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939645184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787868930.532849:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868930.532875:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868930.532965:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645184 00000100:00100000:1.0:1787868930.532969:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645184 00000100:00100000:1.0:1787868930.533001:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787868930.533009:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939645184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787868930.533020:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787868930.533034:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787868930.533036:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787868930.533117:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939645184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868930.533137:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787868930.534613:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939645184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787868930.534704:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787868930.534714:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868930.534737:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868930.849811:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868930.849840:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939645312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868930.849914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868930.849963:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645312 00000100:00100000:3.0:1787868930.849970:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645312 00000100:00100000:3.0:1787868930.850023:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868930.850033:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939645312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868930.850061:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787868930.850106:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939645312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868930.850128:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787868930.850203:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939645312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787868930.850565:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868930.851125:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939645440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868930.851304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868930.851388:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645440 00000100:00100000:1.0:1787868930.851393:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645440 00000100:00100000:1.0:1787868930.851437:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787868930.851445:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939645440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868930.851461:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787868930.863605:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939645440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12149us (12289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868930.863622:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787868930.863787:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868930.865616:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939645440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787868930.977600:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868931.873867:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868931.873901:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939645568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868931.873987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868931.874051:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645568 00000100:00100000:2.0:1787868931.874058:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645568 00000100:00100000:2.0:1787868931.874119:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787868931.874129:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939645568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787868931.874194:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787868931.874239:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939645568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868931.874254:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787868931.874300:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939645568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868931.874525:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868931.874539:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939645696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868931.874575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868931.874739:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645696 00000100:00100000:3.0:1787868931.874744:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645696 00000100:00100000:3.0:1787868931.874775:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868931.874783:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939645696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868931.874805:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787868931.874853:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939645696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868931.874860:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787868931.874870:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939645696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787868932.003865:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787868932.514250:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787868933.025285:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787868933.923026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868933.923035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787868933.923040:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868933.923067:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93dab6f68000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868933.923106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d98813fc00 x1874715939646208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868933.923123:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939646080:0@lo:400:kworker.0 00000100:00080000:2.0:1787868933.923143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787868933.923146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787868933.923147:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868933.923175:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93dab7ecf800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868933.923186:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d98813f480 x1874715939646720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868933.923213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923248:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939645824:0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939646848:0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923293:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939647360:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939646464:0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923327:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923330:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787868933.923336:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939645952:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923341:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939647104:0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923371:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939646592:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923373:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787868933.923377:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939646336:0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939647232:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923415:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939646976:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923437:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939646208:0@lo:8:kworker.0 00000100:00100000:0.0:1787868933.923457:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868933.923463:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645824 00000100:00100000:0.0:1787868933.923472:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939646720:0@lo:8:kworker.0 00000100:00100000:2.0:1787868933.923476:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645824 00000100:00100000:0.0:1787868933.923489:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.923514:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646080 00000100:00100000:2.0:1787868933.923517:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787868933.923517:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646080 00000100:00100000:2.0:1787868933.923524:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3637:x1874715939645824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923544:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646592 00000100:00100000:0.0:1787868933.923546:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646592 00000100:00100000:0.0:1787868933.923559:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646208 00000100:00100000:0.0:1787868933.923561:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646208 00000100:00100000:2.0:1787868933.923567:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3637:x1874715939645824:12345-0@lo:400:kworker.0 Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.923569:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646720 00000100:00100000:0.0:1787868933.923571:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646720 00000100:00100000:2.0:1787868933.923575:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787868933.923579:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787868933.923584:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939646080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923605:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646464 00000100:00100000:2.0:1787868933.923608:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646464 00000100:00100000:0.0:1787868933.923614:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939646080:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.923620:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787868933.923630:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939645952 00000100:00100000:0.0:1787868933.923631:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787868933.923632:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939645952 00000100:00100000:0.0:1787868933.923636:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939646592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923643:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787868933.923649:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923660:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939646592:12345-0@lo:400:kworker.0 Request processed in 24us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.923674:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939646464:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.923681:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787868933.923692:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868933.923697:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939645952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.923737:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939645952:12345-0@lo:400:kworker.0 Request processed in 40us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.923742:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868933.923760:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646848 00000100:00100000:2.0:1787868933.923763:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646848 00000100:00100000:2.0:1787868933.923780:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647360 00000100:00100000:2.0:1787868933.923788:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647360 00000100:00100000:2.0:1787868933.923805:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647104 00000100:00100000:2.0:1787868933.923807:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647104 00000100:00100000:2.0:1787868933.923819:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646336 00000100:00100000:2.0:1787868933.923821:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646336 00000100:00100000:2.0:1787868933.923830:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939646976 00000100:00100000:2.0:1787868933.923832:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939646976 00000100:00100000:2.0:1787868933.923847:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868933.923858:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939646848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868933.923872:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787868933.923886:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787868933.923887:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939646848:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.923890:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939646208:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787868933.923893:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787868933.923903:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787868933.923908:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939647360:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787868933.923914:0:18596:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000100:00100000:2.0:1787868933.923930:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939647360:12345-0@lo:400:kworker.0 Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.923935:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:0.0:1787868933.923941:0:18596:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2e569 00000100:00100000:2.0:1787868933.923945:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787868933.923950:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939647104:12345-0@lo:400:kworker.0 00002000:00100000:0.0:1787868933.923958:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93da862db800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787868933.923963:0:18596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787868933.923966:0:18596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787868933.923970:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939647104:12345-0@lo:400:kworker.0 Request processed in 21us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.923974:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787868933.923985:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787868933.923990:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939646336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.924030:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939646336:12345-0@lo:400:kworker.0 Request processed in 39us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.924035:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787868933.924052:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787868933.924070:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939646976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.924098:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939646976:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868933.924104:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787868933.924143:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813d2c0 x1874715939646336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868933.924181:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939646336:0@lo:400:kworker.0 00010000:00080000:2.0:1787868933.924195:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813da40 x1874715939646976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868933.924202:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939646976:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.924210:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939645824:0@lo:400:kworker.0 00000100:00100000:2.0:1787868933.924218:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939646464:0@lo:400:kworker.0 00010000:00080000:2.0:1787868933.924227:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813cb40 x1874715939647104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868933.924235:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939647104:0@lo:400:kworker.0 00002000:00080000:0.0:1787868933.924613:0:18596:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787868933.924642:0:18596:0:(import.c:65:import_set_state_nolock()) ffff93da862da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868933.924698:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939646208:12345-0@lo:8:kworker.0 Request processed in 806us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.924705:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787868933.924721:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787868933.924725:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1874715939646720:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787868933.924742:0:18596:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:0.0:1787868933.924759:0:18596:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2e570 00002000:00100000:0.0:1787868933.924766:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93da862d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787868933.924769:0:18596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787868933.924771:0:18596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787868933.924798:0:18596:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787868933.924811:0:18596:0:(import.c:65:import_set_state_nolock()) ffff93da862dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787868933.924838:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939646720:12345-0@lo:8:kworker.0 Request processed in 112us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.924844:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787868933.924887:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868933.924891:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868933.924893:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787868933.924924:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813fc00 x1874715939646208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868933.924937:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787868933.924945:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787868933.924954:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787868933.924957:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787868933.924970:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787868933.924975:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939646208:0@lo:8:kworker.0 00010000:00080000:0.0:1787868933.924989:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813f480 x1874715939646720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787868958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868933.925286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787868933.925320:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e580 x1874715939646848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868933.925328:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939646848:0@lo:400:kworker.0 00010000:00080000:1.0:1787868933.925343:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813c000 x1874715939647360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868933.925350:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939647360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868933.925362:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939646080:0@lo:400:kworker.0 00000100:00100000:1.0:1787868933.925454:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939645952:0@lo:400:kworker.0 00000100:00100000:1.0:1787868933.925464:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939646592:0@lo:400:kworker.0 00000100:00100000:1.0:1787868933.925490:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647232 00000100:00100000:1.0:1787868933.925495:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647232 00000100:00100000:1.0:1787868933.925535:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787868933.925543:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939647232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868933.925586:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939647232:12345-0@lo:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868933.925592:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787868933.925618:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813ed00 x1874715939647232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868933.925628:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939647232:0@lo:400:kworker.0 00000100:00080000:1.0:1787868933.925651:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868933.925831:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787868933.925839:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787868933.925843:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787868933.925846:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787868933.925859:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787868933.925864:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939646720:0@lo:8:kworker.0 00000004:00080000:0.0:1787868933.925924:0:17833:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787868933.925947:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939647616:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787868933.925982:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868933.926848:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939647488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868933.926899:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787868933.927240:0:17115:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787868933.927267:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1874715939647872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787868933.927299:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868933.927321:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988180d80 going to sleep for 11 seconds 00000004:00080000:3.0:1787868933.927340:0:17114:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787868933.927549:0:17114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 558053391734ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787868933.927556:0:17114:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787868933.927760:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647616 00000100:00100000:3.0:1787868933.927769:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647616 00000100:00100000:3.0:1787868933.927824:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647872 00000100:00100000:3.0:1787868933.927827:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647872 00000100:00100000:3.0:1787868933.927854:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787868933.927864:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17833:x1874715939647616:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787868933.928095:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868933.928103:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17115:x1874715939647872:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1787868933.928140:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868933.928200:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868933.928218:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939647744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868933.928266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.928307:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647488 00000100:00100000:0.0:1787868933.928311:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647488 00000100:00100000:0.0:1787868933.928329:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939647744 00000100:00100000:0.0:1787868933.928331:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939647744 00000100:00100000:0.0:1787868933.928343:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868933.928348:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1874715939647488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868933.928363:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787868933.928556:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1874715939647488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.928572:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787868933.928590:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787868933.928596:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939647744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868933.928606:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787868933.928635:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939647744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868933.928641:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787868933.928672:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989066940 x1874715939647744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868933.928691:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939647744:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787868933.928731:0:17832:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787868933.928795:0:17832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 558054638862ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787868933.928801:0:17832:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1787868933.929955:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0de00 x1874715939647488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787868949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868933.929982:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939647488:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1787868933.938987:0:17822:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1787868933.952195:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787868933.954028:0:18594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787868933.954039:0:18594:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787868933.954500:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17833:x1874715939647616:12345-0@lo:7:osp-pre-1-1.0 Request processed in 26631us (28511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868933.954513:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787868933.954604:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f0d680 x1874715939647616/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787868949 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868933.954620:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939647616:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787868933.954634:0:17833:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787868933.954686:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939648000:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787868933.954723:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868933.954750:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab6fb2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787868933.954848:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648000 00000100:00100000:3.0:1787868933.954854:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648000 00000100:00100000:3.0:1787868933.954905:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787868933.954915:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17833:x1874715939648000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787868933.954945:0:18597:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787868933.954982:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17833:x1874715939648000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868933.954989:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787868933.955040:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d986f96940 x1874715939648000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787868949 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868933.955048:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f96940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939648000:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787868933.955069:0:17833:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787868933.955098:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939648128:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787868933.955120:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868933.955134:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868933.955146:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648128 00000100:00100000:3.0:1787868933.955178:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648128 00000100:00100000:3.0:1787868933.955205:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787868933.955211:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17833:x1874715939648128:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787868933.955236:0:18597:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1787868933.959986:0:19034:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787868933.960009:0:19034:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787868933.960015:0:19034:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:3.0:1787868933.979556:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.979571:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.979590:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.979595:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.979603:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.979621:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.979632:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.979652:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.979673:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787868933.980244:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.980251:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980261:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.980264:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.980269:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980278:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980285:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980292:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980309:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787868933.980646:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868933.980656:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980676:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.980681:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980689:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980708:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980716:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000880b1025/0x2f11f4d3bde2e577 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980740:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868933.980743:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980750:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.980753:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980760:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980770:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980783:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db7d443/0x2f11f4d3bde2e57e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.980797:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.980798:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.980800:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787868933.980881:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.980887:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980901:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.980904:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.980909:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980919:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980927:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980935:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.980957:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868933.981327:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868933.981333:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981341:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.981344:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981351:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981363:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981369:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e585 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981383:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.981385:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.981386:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787868933.981569:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.981574:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.981582:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.981585:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.981590:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.981599:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.981616:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.981623:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.981645:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868933.981863:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868933.981868:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981875:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828da00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.981879:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981886:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981898:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981905:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e58c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.981919:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.981920:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.981921:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787868933.981989:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.982005:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982013:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.982016:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.982020:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982028:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982035:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982043:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982238:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868933.982344:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868933.982630:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868933.982636:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982644:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.982648:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982667:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982678:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982685:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5693c29/0x2f11f4d3bde2e593 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.982702:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.982703:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.982704:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787868933.982781:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.982787:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982795:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.982798:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.982803:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982812:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982820:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982828:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.982877:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787868933.983331:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.983338:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.983348:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.983357:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.983362:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.983372:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.983379:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.983387:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983503:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868933.983510:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983518:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.983521:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983529:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983543:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983561:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2e59a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983578:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868933.983581:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983587:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868933.983590:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983598:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983608:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868933.983615:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.983616:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.983618:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868933.988396:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787868933.988419:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2e5a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787868933.989256:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.989265:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.989280:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.989285:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.989292:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.989306:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.989322:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.989328:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.989354:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787868933.990218:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787868933.990226:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990238:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1787868933.990241:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868933.990245:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990256:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990264:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990270:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990298:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787868933.990309:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868933.990316:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990323:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868933.990327:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990336:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990353:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990360:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e0e0a2e/0x2f11f4d3bde2e5a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990374:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868933.990377:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990383:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868933.990386:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990404:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990415:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990421:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2e5af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868933.990432:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868933.990434:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868933.990435:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868933.990779:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868933.992743:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787868934.002539:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868934.002553:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.002572:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1787868934.002577:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868934.002584:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.002609:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.002620:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.002628:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.003147:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787868934.004115:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868934.004125:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.004141:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1787868934.004145:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868934.004196:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.004210:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.004219:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.004240:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010322:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868934.010335:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010349:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.010355:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010366:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010389:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010409:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ba6007/0x2f11f4d3bde2e5b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010431:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868934.010436:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010442:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.010445:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010453:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010463:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.010469:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.010471:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.010473:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868934.012679:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787868934.012692:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab03cd8d/0x2f11f4d3bde2e5bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.015897:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787868934.016687:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787868934.016699:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.016743:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=558s v=(0 0) 00010000:00010000:0.0:1787868934.016748:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868934.016755:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.016772:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.016784:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.016793:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.016856:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787868934.019975:0:19410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00002000:00010000:1.0:1787868934.020318:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787868934.020330:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.020350:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1787868934.020355:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787868934.020364:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.020381:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.020393:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868934.020401:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787868934.020518:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787868934.020529:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787868934.020695:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17833:x1874715939648128:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65479us (65567us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787868934.020706:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787868934.021213:0:17833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787868934.021223:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1874715939648128:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787868934.021242:0:17833:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787868934.021296:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17833:1874715939648256:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787868934.021350:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868934.021375:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986c0bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787868934.021405:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648256 00000100:00100000:3.0:1787868934.021412:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648256 00000100:00100000:3.0:1787868934.021451:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787868934.021460:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17833:x1874715939648256:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787868934.021510:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17833:x1874715939648256:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868934.021517:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787868934.021550:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9890661c0 x1874715939648256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787868950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868934.021561:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17833:1874715939648256:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1787868934.024712:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787868934.024732:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024749:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868934.024763:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024778:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024806:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024815:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2e5c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024842:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868934.024847:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024854:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868934.024858:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024865:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024875:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.024883:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.024891:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.024893:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868934.029611:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787868934.029630:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab841d0/0x2f11f4d3bde2e5cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.030575:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.032323:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.032335:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.032354:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.032359:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.032365:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.032380:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.032390:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.032397:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.032414:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787868934.034216:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868934.034232:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.034245:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.034258:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.034270:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.034292:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.034301:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b852206/0x2f11f4d3bde2e5d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.034321:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.034323:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.034325:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.035328:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.035343:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035361:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.035366:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.035381:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035395:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035406:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035413:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035432:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868934.035444:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868934.035448:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035457:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868934.035460:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035469:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035482:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035502:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e5d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.035517:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.035519:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.035521:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.036237:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.036247:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036259:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.036262:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.036267:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036278:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036286:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036294:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036308:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868934.036315:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868934.036327:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036334:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868934.036337:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036345:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036358:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036365:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e5e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.036380:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.036382:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.036383:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.037331:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.037341:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.037354:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.037358:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.037363:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.037386:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.037396:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.037404:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.037463:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787868934.038756:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.038770:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.038785:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.038789:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.038797:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.038808:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.038818:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.038837:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044317:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868934.044334:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044349:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.044354:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044367:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044392:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044408:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f972e23/0x2f11f4d3bde2e5e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044431:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868934.044434:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044440:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.044443:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044451:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044460:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.044467:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.044469:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.044470:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.045766:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868934.045780:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e5ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.045818:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.046500:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.046511:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046529:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.046535:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.046543:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046558:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046567:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046575:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046603:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868934.046615:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868934.046620:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046628:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787868934.046632:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046641:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046660:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046668:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e5f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046683:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.046685:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.046687:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.046960:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.046966:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046975:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.046983:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.046988:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.046998:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.047006:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.047013:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.051353:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787868934.052088:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.052099:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.052118:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.052124:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.052131:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.052145:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.052296:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.052311:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052596:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787868934.052605:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052614:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.052620:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052629:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052648:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052667:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5479f15/0x2f11f4d3bde2e5fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052684:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868934.052688:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052694:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.052697:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052705:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052716:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.052723:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.052725:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.052727:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.055922:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.056272:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868934.056286:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c0af8d/0x2f11f4d3bde2e603 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868934.056920:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.056929:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.056945:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.056951:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.056958:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.056974:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.056984:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.056992:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.057170:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868934.057178:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.057186:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.057197:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.057205:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.057223:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.057233:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.057235:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.057237:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.059419:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868934.059443:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8916be1/0x2f11f4d3bde2e60a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868934.061436:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.061451:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.061470:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.061474:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.061481:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.061497:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.061508:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.061517:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.062738:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868934.062753:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.062765:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868934.062770:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.062781:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.062805:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868934.062814:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.062824:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.062825:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868934.064725:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787868934.064738:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d8eb6b3/0x2f11f4d3bde2e611 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868934.065461:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.065471:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065487:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.065492:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.065499:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065514:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065524:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065531:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065555:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787868934.065866:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.065872:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065880:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.065883:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.065894:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065903:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065910:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065917:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.065931:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787868934.066283:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.066289:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066297:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.066300:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.066304:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066313:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066320:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066339:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066347:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787868934.066601:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787868934.066611:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066619:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.066632:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066642:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066663:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066671:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d019d61/0x2f11f4d3bde2e618 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066692:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868934.066695:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066701:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.066704:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066710:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066719:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066725:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009426807b/0x2f11f4d3bde2e61f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066743:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868934.066746:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066753:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.066755:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066762:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066771:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066778:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ef03ea2/0x2f11f4d3bde2e626 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.066791:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.066793:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.066794:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787868934.066928:0:19034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787868934.066934:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066942:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=558s v=(0 0) 00010000:00010000:2.0:1787868934.066946:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868934.066951:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066960:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066968:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.066976:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868934.067000:0:19034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787868934.067035:0:19034:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1787868934.067206:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17115:x1874715939647872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 139097us (139899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868934.067227:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787868934.067426:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868934.067431:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.067441:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868934.067452:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.067460:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.067473:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.067481:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007817304b/0x2f11f4d3bde2e62d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868934.067496:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.067498:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868934.067500:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.067939:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868934.067945:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868934.067987:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1874715939647872:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787868934.068005:0:17115:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787868934.068118:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1874715939648384:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787868934.070064:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868934.070111:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986c0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787868934.070311:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648384 00000100:00100000:2.0:1787868934.070320:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648384 00000100:00100000:2.0:1787868934.070384:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787868934.070395:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17115:x1874715939648384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787868934.070440:0:18594:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1787868934.076439:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17115:x1874715939648384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6036us (6385us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787868934.076455:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787868934.078856:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1874715939648384:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787868934.078878:0:17115:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1787868935.074601:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868935.969541:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939648512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868935.969620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868935.969792:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939648640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868935.969823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868935.969864:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648512 00000100:00100000:1.0:1787868935.969872:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648512 00000100:00100000:1.0:1787868935.969911:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648640 00000100:00100000:1.0:1787868935.969913:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648640 00000100:00100000:1.0:1787868935.969931:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868935.969939:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939648512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868935.969968:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787868935.970003:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939648512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868935.970010:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787868935.970038:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868935.970045:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939648640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868935.970055:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787868935.970082:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939648640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868935.970088:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787868935.970138:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939648640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868935.970491:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939648512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787868935.970639:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787868936.097344:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787868936.579869:0:19765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787868936.995597:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868936.995627:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939648768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868936.995701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868936.995759:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648768 00000100:00100000:0.0:1787868936.995766:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648768 00000100:00100000:0.0:1787868936.995814:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868936.995824:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939648768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787868936.995861:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787868936.995903:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939648768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868936.995917:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868936.995964:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939648768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868936.999610:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939648896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868936.999687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868936.999833:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939648896 00000100:00100000:3.0:1787868936.999843:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939648896 00000100:00100000:3.0:1787868936.999901:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868936.999913:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939648896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868936.999956:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787868937.000025:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939648896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868937.000033:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868937.000082:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939648896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787868937.124323:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787868937.708532:0:19817:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787868937.708795:0:19817:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1787868937.827095:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787868938.147476:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787868938.837863:0:19868:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787868938.838291:0:19868:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787868939.043645:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939649024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868939.043786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868939.043900:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868939.043917:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939649152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868939.043943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868939.043992:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649024 00000100:00100000:3.0:1787868939.044000:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649024 00000100:00100000:3.0:1787868939.044042:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649152 00000100:00100000:3.0:1787868939.044045:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649152 00000100:00100000:3.0:1787868939.044063:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868939.044071:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939649024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868939.044100:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868939.044141:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939649024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868939.044149:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868939.044189:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787868939.044196:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939649152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868939.044205:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868939.044228:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939649152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868939.044234:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787868939.044249:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868939.044480:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939649152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868939.044502:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939649024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868939.048485:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939649664:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.048587:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939650176:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.048632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787868939.048638:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939649536:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.048853:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939650048:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.048898:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939650560:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.048968:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939649280:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.048997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049026:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939649792:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.049050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049067:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939650304:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.049087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049100:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787868939.049107:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939649408:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.049126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049142:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939649920:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.049183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049206:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939650432:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.049240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868939.049265:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649664 00000100:00100000:1.0:1787868939.049272:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649664 00000100:00100000:2.0:1787868939.049504:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649536 00000100:00100000:2.0:1787868939.049509:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649536 00000100:00100000:2.0:1787868939.049555:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649920 00000100:00100000:2.0:1787868939.049558:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649920 00000100:00100000:2.0:1787868939.049579:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787868939.049588:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939649536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868939.049647:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939649536:12345-0@lo:400:kworker.0 Request processed in 60us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.049654:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787868939.049670:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787868939.049676:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939649920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.050469:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650176 00000100:00100000:1.0:1787868939.050475:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650176 00000100:00100000:1.0:1787868939.050490:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650048 00000100:00100000:1.0:1787868939.050492:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650048 00000100:00100000:1.0:1787868939.050502:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650560 00000100:00100000:1.0:1787868939.050504:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650560 00000100:00100000:1.0:1787868939.050514:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650304 00000100:00100000:1.0:1787868939.050516:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650304 00000100:00100000:1.0:1787868939.050526:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650432 00000100:00100000:1.0:1787868939.050529:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650432 00000100:00100000:1.0:1787868939.050541:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868939.050547:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939649664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.050591:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939649664:12345-0@lo:400:kworker.0 Request processed in 44us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.050597:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787868939.050610:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868939.050615:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939650176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.050640:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939650176:12345-0@lo:400:kworker.0 Request processed in 26us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.050979:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939649920:12345-0@lo:400:kworker.0 Request processed in 1302us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.051002:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787868939.051873:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787868939.051896:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868939.051905:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939650048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.051966:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939650048:12345-0@lo:400:kworker.0 Request processed in 53us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.051972:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787868939.051992:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868939.052000:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939650560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.052033:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939650560:12345-0@lo:400:kworker.0 Request processed in 34us (3113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.052039:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868939.052050:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868939.052056:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939650304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.052084:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939650304:12345-0@lo:400:kworker.0 Request processed in 28us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.052089:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868939.052101:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868939.052107:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939650432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.052135:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939650432:12345-0@lo:400:kworker.0 Request processed in 29us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.052142:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787868939.053654:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868939.053661:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868939.053663:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868939.056498:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649280 00000100:00100000:1.0:1787868939.056513:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649280 00000100:00100000:1.0:1787868939.056563:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787868939.056573:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3636:x1874715939649280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.056675:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3636:x1874715939649280:12345-0@lo:400:kworker.0 Request processed in 103us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.056684:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787868939.056723:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649792 00000100:00100000:1.0:1787868939.056728:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649792 00000100:00100000:1.0:1787868939.056746:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939649408 00000100:00100000:1.0:1787868939.056749:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939649408 00000100:00100000:1.0:1787868939.056762:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787868939.056776:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939649792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.056814:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939649792:12345-0@lo:400:kworker.0 Request processed in 39us (7763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.056820:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787868939.056832:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787868939.056838:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939649408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.056866:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939649408:12345-0@lo:400:kworker.0 Request processed in 28us (7739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.056872:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787868939.056920:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939649536:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.056938:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c53840 x1874715939650048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.056949:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939650048:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.056976:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c52940 x1874715939650560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.056985:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939650560:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.057000:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989064b40 x1874715939649664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.057009:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989064b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939649664:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.057020:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c50000 x1874715939650176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.057028:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939650176:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.057070:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939649408:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.057091:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939649920:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.057103:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c51a40 x1874715939650432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.057112:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939650432:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.057121:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939649280:0@lo:400:kworker.0 00000100:00100000:1.0:1787868939.057131:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939649792:0@lo:400:kworker.0 00010000:00080000:1.0:1787868939.057144:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d987c512c0 x1874715939650304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868939.057151:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939650304:0@lo:400:kworker.0 00010000:00010000:0.0:1787868939.169773:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868939.201927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.202184:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918586752 00000100:00100000:2.0:1787868939.202196:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918586752 00000100:00100000:2.0:1787868939.202251:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1787868939.202260:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1874715918586752:12345-192.168.204.27@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787868939.202299:0:17082:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 847e79f0-919e-4251-863a-9b10feb7d22a@192.168.204.27@tcp t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:2.0:1787868939.202330:0:17082:0:(genops.c:1385:class_connect()) connect: client 847e79f0-919e-4251-863a-9b10feb7d22a, cookie 0x2f11f4d3bde2e634 00000100:00080000:2.0:1787868939.202482:0:17082:0:(import.c:65:import_set_state_nolock()) ffff93dab5238800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868939.202575:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+5:2402:x1874715918586752:12345-192.168.204.27@tcp:250:mount.lustre.0 Request processed in 315us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.202584:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:3.0:1787868939.211300:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.214654:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918586880 00000100:00100000:0.0:1787868939.214671:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918586880 00000100:00100000:0.0:1787868939.214750:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:0.0:1787868939.214761:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+5:14909:x1874715918586880:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787868939.214779:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868939.214799:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2e63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff33b expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.214831:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2e63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff33b expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.214842:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2e63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff33b expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.214852:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287a00, rc 0) 00000100:00100000:0.0:1787868939.216180:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+6:14909:x1874715918586880:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 1390us (4871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.216191:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:3.0:1787868939.229979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.230355:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587008 00000100:00100000:2.0:1787868939.230373:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587008 00000100:00100000:2.0:1787868939.230445:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1787868939.230457:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+6:14909:x1874715918587008:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787868939.230593:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+6:14909:x1874715918587008:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 138us (641us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787868939.230602:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1787868939.238803:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.240444:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587136 00000100:00100000:0.0:1787868939.240490:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587136 00000100:00100000:0.0:1787868939.240585:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:0.0:1787868939.240599:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+6:14909:x1874715918587136:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787868939.240626:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868939.240653:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff342 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.240695:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff342 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.240709:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff342 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868939.240721:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787868939.240815:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+7:14909:x1874715918587136:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 220us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.240823:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:1.0:1787868939.249666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.249812:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587264 00000100:00100000:2.0:1787868939.249826:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587264 00000100:00100000:2.0:1787868939.249911:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:2.0:1787868939.249923:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+7:14909:x1874715918587264:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787868939.250268:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+8:14909:x1874715918587264:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 344us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.250301:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:3.0:1787868939.255151:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.255683:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587392 00000100:00100000:2.0:1787868939.255699:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587392 00000100:00100000:2.0:1787868939.255785:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1787868939.255800:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+8:14909:x1874715918587392:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787868939.256322:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+8:14909:x1874715918587392:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 522us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.256333:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:3.0:1787868939.263795:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.264816:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587520 00000100:00100000:0.0:1787868939.264834:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587520 00000100:00100000:1.0:1787868939.265396:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:1.0:1787868939.265410:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587520:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787868939.265679:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587520:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 270us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.265689:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1787868939.298543:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.299632:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587648 00000100:00100000:1.0:1787868939.299651:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587648 00000100:00100000:1.0:1787868939.299748:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:1.0:1787868939.299761:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587648:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787868939.300015:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587648:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 255us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.300025:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:3.0:1787868939.311605:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.312299:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587776 00000100:00100000:1.0:1787868939.312318:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587776 00000100:00100000:0.0:1787868939.317781:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:0.0:1787868939.317807:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587776:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868939.318589:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+8:14928:x1874715918587776:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 786us (6993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.318602:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1787868939.323702:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.323857:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918587904 00000100:00100000:1.0:1787868939.323870:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918587904 00000100:00100000:1.0:1787868939.324222:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:1.0:1787868939.324237:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+8:14909:x1874715918587904:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787868939.324260:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868939.324284:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2e649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff373 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.324325:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2e649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff373 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.324339:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2e649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff373 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.324350:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2070000, rc 0) 00000100:00100000:1.0:1787868939.324466:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+9:14909:x1874715918587904:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 232us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.324474:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1787868939.327978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.328294:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588032 00000100:00100000:0.0:1787868939.328308:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588032 00000100:00100000:0.0:1787868939.328385:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:0.0:1787868939.328399:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+9:14909:x1874715918588032:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787868939.328454:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787868939.328477:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787868939.328482:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787868939.328486:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787868939.328489:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787868939.328492:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787868939.330586:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+9:14909:x1874715918588032:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 2175us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.330604:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1787868939.335906:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.336224:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588160 00000100:00100000:2.0:1787868939.336237:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588160 00000100:00100000:2.0:1787868939.336318:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1787868939.336331:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+9:14909:x1874715918588160:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787868939.336356:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868939.336380:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff37a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868939.336419:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868939.336432:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868939.336443:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871400, rc 0) 00000100:00100000:2.0:1787868939.336519:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+10:14909:x1874715918588160:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 191us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.336526:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1787868939.342403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.342615:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588288 00000100:00100000:0.0:1787868939.342630:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588288 00000100:00100000:0.0:1787868939.342700:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:0.0:1787868939.342712:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8423a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:14909:x1874715918588288:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787868939.343518:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8423a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:14909:x1874715918588288:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 799us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.343530:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:0.0:1787868939.356918:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.357038:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588416 00000100:00100000:1.0:1787868939.357050:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588416 00000100:00100000:1.0:1787868939.357125:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1787868939.357138:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+10:14909:x1874715918588416:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787868939.357421:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+10:14909:x1874715918588416:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 284us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.357429:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:3.0:1787868939.383018:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.383430:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588544 00000100:00100000:0.0:1787868939.383445:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588544 00000100:00100000:0.0:1787868939.383534:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:0.0:1787868939.383548:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:14932:x1874715918588544:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868939.383799:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:14932:x1874715918588544:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 253us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.383811:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:3.0:1787868939.389966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.390252:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588672 00000100:00100000:2.0:1787868939.390272:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588672 00000100:00100000:2.0:1787868939.390359:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:2.0:1787868939.390374:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+10:14932:x1874715918588672:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787868939.390617:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+10:14932:x1874715918588672:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 246us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.390627:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:3.0:1787868939.397507:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868939.397635:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.400229:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588800 00000100:00100000:2.0:1787868939.400254:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588800 00000100:00100000:2.0:1787868939.400334:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589056 00000100:00100000:2.0:1787868939.400339:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589056 00000100:00100000:2.0:1787868939.400365:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1787868939.400377:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918588800:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787868939.400422:0:17088:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:2.0:1787868939.400500:0:17088:0:(genops.c:1385:class_connect()) connect: client 3b83fde6-fad6-4b0f-a839-62ce511e8e7d, cookie 0x2f11f4d3bde2e657 00000004:00100000:2.0:1787868939.400542:0:17088:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787868939.400844:0:17088:0:(import.c:65:import_set_state_nolock()) ffff93dab523a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868939.400958:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2402:x1874715918588800:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 571us (3457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.400968:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1787868939.400994:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1787868939.400999:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918589056:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787868939.401018:0:17088:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:2.0:1787868939.401412:0:17088:0:(genops.c:1385:class_connect()) connect: client 3b83fde6-fad6-4b0f-a839-62ce511e8e7d, cookie 0x2f11f4d3bde2e65e 00000004:00100000:2.0:1787868939.401438:0:17088:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787868939.401635:0:17088:0:(import.c:65:import_set_state_nolock()) ffff93dab523c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787868939.401669:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2402:x1874715918589056:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 667us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868939.401677:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1787868939.406386:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.406426:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868939.406584:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.412488:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589184 00000100:00100000:3.0:1787868939.412622:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589312 00000100:00100000:3.0:1787868939.412647:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589312 00000100:00100000:3.0:1787868939.412744:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918588928 00000100:00100000:3.0:1787868939.412748:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918588928 00000100:00100000:3.0:1787868939.412777:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868939.412793:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:14909:x1874715918589312:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787868939.412861:0:17089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787868939.413462:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:14909:x1874715918589312:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 666us (7027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868939.413474:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868939.413508:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787868939.413517:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:0:x1874715918588928:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787868939.413538:0:17089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787868939.413568:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:0:x1874715918588928:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 53us (6983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868939.413574:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1787868939.414474:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589184 00000100:00100000:0.0:1787868939.414598:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1787868939.414609:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:0:x1874715918589184:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787868939.414649:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787868939.414730:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:0:x1874715918589184:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 123us (8361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.414737:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:2.0:1787868939.421443:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868939.421460:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868939.422775:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.422926:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589440 00000100:00100000:1.0:1787868939.423694:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589440 00000100:00100000:1.0:1787868939.427552:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1787868939.427581:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589440:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787868939.428869:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589440:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 1285us (6095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.428885:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1787868939.443967:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.444215:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589824 00000100:00100000:0.0:1787868939.444230:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589824 00000100:00100000:0.0:1787868939.444316:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1787868939.444330:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589824:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787868939.444449:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589824:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 122us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.444458:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1787868939.445106:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868939.445292:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.445853:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589568 00000100:00100000:1.0:1787868939.445865:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589568 00000100:00100000:1.0:1787868939.445904:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589696 00000100:00100000:1.0:1787868939.445907:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589696 00000100:00100000:1.0:1787868939.445927:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1787868939.445935:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874715918589568:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787868939.445992:0:18594:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:1.0:1787868939.446037:0:18594:0:(genops.c:1385:class_connect()) connect: client 3b83fde6-fad6-4b0f-a839-62ce511e8e7d, cookie 0x2f11f4d3bde2e665 00002000:00100000:1.0:1787868939.446053:0:18594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b83fde6-fad6-4b0f-a839-62ce511e8e7d/ffff93d981c0c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787868939.446086:0:18594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787868939.446184:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1787868939.446191:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918589696:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787868939.446208:0:18596:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:3.0:1787868939.446227:0:18596:0:(genops.c:1385:class_connect()) connect: client 3b83fde6-fad6-4b0f-a839-62ce511e8e7d, cookie 0x2f11f4d3bde2e66c 00002000:00100000:3.0:1787868939.446232:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b83fde6-fad6-4b0f-a839-62ce511e8e7d/ffff93d987fb3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787868939.446239:0:18596:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787868939.446349:0:18594:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1787868939.446382:0:18596:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787868939.446390:0:18594:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787868939.446395:0:18596:0:(import.c:65:import_set_state_nolock()) ffff93d987fb6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787868939.446460:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2402:x1874715918589568:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 525us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.446481:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1787868939.448985:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2402:x1874715918589696:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 2774us (3673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868939.449003:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1787868939.459150:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868939.461305:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918589952 00000100:00100000:0.0:1787868939.461327:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918589952 00000100:00100000:0.0:1787868939.461426:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868939.461439:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589952:12345-192.168.204.27@tcp:33:mount.lustre.0 00000001:00100000:2.0:1787868939.462796:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00080000:2.0:1787868939.462820:0:19410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00080000:3.0:1787868939.471435:0:17091:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9878us 00000004:00200000:0.0:1787868939.522742:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787868939.522973:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14909:x1874715918589952:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 61529us (63832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868939.522987:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868939.766659:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868939.770631:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590080 00000100:00100000:1.0:1787868939.770652:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590080 00000100:00100000:1.0:1787868939.771329:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1787868939.771349:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:14955:x1874715918590080:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1787868939.771389:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868939.771456:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070600/0x2f11f4d3bde2e673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff3ab expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771565:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771583:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771603:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868939.771675:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787868939.771680:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868939.771865:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771899:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2070600/0x2f11f4d3bde2e673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ab expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771923:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ab expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868939.771932:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:1.0:1787868939.771935:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787868939.771939:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2071000, rc 0) 00000100:00100000:1.0:1787868939.772067:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:14955:x1874715918590080:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 724us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868939.772075:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:1.0:1787868940.194645:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868941.089581:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868941.089620:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939650688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868941.089727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868941.090262:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650688 00000100:00100000:1.0:1787868941.090278:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650688 00000100:00100000:1.0:1787868941.090381:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868941.090396:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939650688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868941.090446:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787868941.090525:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939650688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868941.090534:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787868941.090604:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988192d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939650688:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787868941.090866:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868941.092021:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787868941.092047:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939650816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868941.092134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868941.092312:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650816 00000100:00100000:3.0:1787868941.092321:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650816 00000100:00100000:3.0:1787868941.092407:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787868941.092418:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939650816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868941.092441:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787868941.092507:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939650816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868941.092533:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787868941.092747:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868941.092799:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939650816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787868941.217406:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868942.086541:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.095725:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590208 00000100:00100000:3.0:1787868942.095747:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590208 00000100:00100000:3.0:1787868942.096007:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787868942.096027:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15007:x1874715918590208:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:3.0:1787868942.096099:0:17089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787868942.096295:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15007:x1874715918590208:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 276us (9770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.096304:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:2.0:1787868942.097453:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868942.103549:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.105018:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590336 00000100:00100000:1.0:1787868942.105043:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590336 00000100:00100000:1.0:1787868942.105202:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1787868942.105228:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:15007:x1874715918590336:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:1.0:1787868942.105283:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868942.105418:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:15007:x1874715918590336:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 198us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.105428:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:2.0:1787868942.106239:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868942.113976:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868942.114087:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939650944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868942.114224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868942.115390:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.115437:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590464 00000100:00100000:0.0:1787868942.115449:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590464 00000100:00100000:0.0:1787868942.115553:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1787868942.115567:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:15007:x1874715918590464:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:0.0:1787868942.115608:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787868942.115725:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:15007:x1874715918590464:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 161us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.115733:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00080000:0.0:1787868942.115773:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868942.116314:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868942.116347:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868942.116407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868942.125661:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939650944 00000100:00100000:1.0:1787868942.125690:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939650944 00000100:00100000:1.0:1787868942.125758:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651072 00000100:00100000:1.0:1787868942.125762:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651072 00000100:00100000:1.0:1787868942.125787:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787868942.125798:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939650944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868942.125844:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787868942.127822:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939650944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2020us (13592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.127836:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787868942.127891:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787868942.127915:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868942.127951:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868942.128007:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (11600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.128013:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787868942.130718:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939650944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868942.132221:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868942.134640:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.134980:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590592 00000100:00100000:0.0:1787868942.134992:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590592 00000100:00100000:0.0:1787868942.135086:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:2.0:1787868942.135093:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868942.135101:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15007:x1874715918590592:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:0.0:1787868942.135196:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787868942.135514:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15007:x1874715918590592:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 412us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.135524:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00010000:00010000:0.0:1787868942.241457:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868942.408293:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.408425:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590720 00000100:00100000:1.0:1787868942.408439:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590720 00000100:00100000:1.0:1787868942.408518:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:1.0:1787868942.408531:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+10:15040:x1874715918590720:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787868942.408557:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868942.408583:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2071400/0x2f11f4d3bde2e681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff3b2 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.408625:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2071400/0x2f11f4d3bde2e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3b2 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.408638:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2071400/0x2f11f4d3bde2e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3b2 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.408649:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2071400, rc 0) 00000100:00100000:1.0:1787868942.408728:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918590720:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 199us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.408737:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:1.0:1787868942.430803:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.431058:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590848 00000100:00100000:0.0:1787868942.431072:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590848 00000100:00100000:0.0:1787868942.431152:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1787868942.431200:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918590848:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787868942.431858:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918590848:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 646us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.431872:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:2.0:1787868942.445908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.446838:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918590976 00000100:00100000:1.0:1787868942.446869:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918590976 00000100:00100000:1.0:1787868942.446966:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:1.0:1787868942.446981:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918590976:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787868942.447233:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918590976:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 254us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.447241:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1787868942.459302:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.468189:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591104 00000100:00100000:2.0:1787868942.468217:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591104 00000100:00100000:2.0:1787868942.468328:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1787868942.469507:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591104:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787868942.473117:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591104:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 4758us (13811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868942.473138:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:0.0:1787868942.527972:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.528108:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591232 00000100:00100000:2.0:1787868942.528123:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591232 00000100:00100000:2.0:1787868942.528258:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:2.0:1787868942.528271:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591232:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787868942.528522:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591232:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 253us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868942.528532:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:3.0:1787868942.531500:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.531917:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591360 00000100:00100000:2.0:1787868942.531933:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591360 00000100:00100000:2.0:1787868942.532030:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:2.0:1787868942.532044:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591360:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787868942.543263:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:15046:x1874715918591360:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 11202us (11759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.543285:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1787868942.559967:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.566425:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591488 00000100:00100000:1.0:1787868942.566451:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591488 00000100:00100000:1.0:1787868942.566583:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1787868942.566598:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+11:15040:x1874715918591488:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787868942.566623:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868942.566652:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2e688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff3e3 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.566709:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2e688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3e3 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.566724:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2e688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3e3 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.566736:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2070a00, rc 0) 00000100:00100000:1.0:1787868942.566841:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+12:15040:x1874715918591488:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 246us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.568435:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1787868942.573694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.579618:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591616 00000100:00100000:0.0:1787868942.579642:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591616 00000100:00100000:0.0:1787868942.580129:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1787868942.580148:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+12:15040:x1874715918591616:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787868942.580207:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787868942.580253:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787868942.580258:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787868942.580262:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787868942.580265:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787868942.580267:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787868942.589415:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+12:15040:x1874715918591616:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 9059us (15535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.589438:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:3.0:1787868942.593481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.593657:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591744 00000100:00100000:1.0:1787868942.593672:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591744 00000100:00100000:1.0:1787868942.593760:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1787868942.593773:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+12:15040:x1874715918591744:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787868942.593798:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868942.593824:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff3ea expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.593880:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.593905:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868942.593918:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dac2070600, rc 0) 00000100:00100000:1.0:1787868942.594005:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+13:15040:x1874715918591744:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 235us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.594013:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1787868942.598061:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.603548:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918591872 00000100:00100000:0.0:1787868942.603571:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918591872 00000100:00100000:0.0:1787868942.603681:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:0.0:1787868942.603694:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15040:x1874715918591872:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787868942.603941:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15040:x1874715918591872:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 249us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.603952:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1787868942.615598:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.615849:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592000 00000100:00100000:2.0:1787868942.615866:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592000 00000100:00100000:2.0:1787868942.617286:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:2.0:1787868942.617325:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:15040:x1874715918592000:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787868942.617567:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:15040:x1874715918592000:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 264us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868942.617588:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1787868942.623109:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.632460:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592128 00000100:00100000:1.0:1787868942.632485:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592128 00000100:00100000:1.0:1787868942.632581:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:1.0:1787868942.632595:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15050:x1874715918592128:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787868942.632820:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15050:x1874715918592128:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 227us (9725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.637581:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1787868942.655942:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.656660:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592256 00000100:00100000:1.0:1787868942.656695:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592256 00000100:00100000:1.0:1787868942.656781:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:1.0:1787868942.656794:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15050:x1874715918592256:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787868942.657041:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:15050:x1874715918592256:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 250us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868942.657050:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1787868942.666360:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.666406:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.666439:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.666474:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.666506:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.666548:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592896 00000100:00100000:3.0:1787868942.666560:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592896 00000100:00100000:3.0:1787868942.666622:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592768 00000100:00100000:3.0:1787868942.666626:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592768 00000100:00100000:3.0:1787868942.666650:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868942.666661:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918592896:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868942.666780:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918592896:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 120us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.666790:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868942.666810:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868942.666818:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918592768:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868942.666860:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918592768:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.666868:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868942.666911:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592384 00000100:00100000:3.0:1787868942.666915:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592384 00000100:00100000:3.0:1787868942.666931:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592640 00000100:00100000:3.0:1787868942.666933:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592640 00000100:00100000:3.0:1787868942.666950:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918592512 00000100:00100000:3.0:1787868942.666953:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918592512 00000100:00100000:3.0:1787868942.666969:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1787868942.666975:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2406:x1874715918592640:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868942.667028:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2406:x1874715918592640:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.667036:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1787868942.667049:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1787868942.667056:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2405:x1874715918592512:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868942.667081:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2405:x1874715918592512:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.667088:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1787868942.667099:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868942.667111:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874715918592384:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787868942.667140:0:17090:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from f24169c3-92a7-4501-a36f-f9f115268206@192.168.204.27@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:3.0:1787868942.667222:0:17090:0:(genops.c:1385:class_connect()) connect: client f24169c3-92a7-4501-a36f-f9f115268206, cookie 0x2f11f4d3bde2e696 00000004:00100000:3.0:1787868942.667255:0:17090:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868942.667384:0:17090:0:(import.c:65:import_set_state_nolock()) ffff93d9882f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868942.667420:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2402:x1874715918592384:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 308us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.667429:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868942.672306:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.677515:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.682505:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868942.683752:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593152 00000100:00100000:1.0:1787868942.683776:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593152 00000100:00100000:3.0:1787868942.683970:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593408 00000100:00100000:3.0:1787868942.683976:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593408 00000100:00100000:3.0:1787868942.684323:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1787868942.684335:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874715918593152:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787868942.684379:0:17088:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from f24169c3-92a7-4501-a36f-f9f115268206@192.168.204.27@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:3.0:1787868942.684434:0:17088:0:(genops.c:1385:class_connect()) connect: client f24169c3-92a7-4501-a36f-f9f115268206, cookie 0x2f11f4d3bde2e69d 00000004:00100000:3.0:1787868942.684472:0:17088:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787868942.684607:0:17088:0:(import.c:65:import_set_state_nolock()) ffff93d988918000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868942.684712:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2402:x1874715918593152:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 378us (12425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.684722:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1787868942.684747:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:3.0:1787868942.684755:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593408:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787868942.684781:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787868942.684821:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593408:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 67us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.685290:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00080000:3.0:1787868942.685339:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868942.690278:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.690394:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868942.690685:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593024 00000100:00100000:0.0:1787868942.690700:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593024 00000100:00100000:0.0:1787868942.690778:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593536 00000100:00100000:0.0:1787868942.690781:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593536 00000100:00100000:0.0:1787868942.690792:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593280 00000100:00100000:0.0:1787868942.690794:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593280 00000100:00100000:0.0:1787868942.690841:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868942.690854:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+7:0:x1874715918593024:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787868942.690909:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787868942.691244:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+7:0:x1874715918593024:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 390us (8752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.691254:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868942.691278:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1787868942.691285:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593536:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787868942.691329:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593536:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 45us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.691336:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1787868942.691348:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868942.691355:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:0:x1874715918593280:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787868942.691368:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787868942.691398:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:0:x1874715918593280:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 43us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.691405:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868942.694616:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00080000:2.0:1787868942.694970:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868942.695680:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593920 00000100:00100000:0.0:1787868942.695700:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593920 00000100:00100000:0.0:1787868942.695789:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868942.695802:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593920:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787868942.695982:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918593920:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 182us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.696050:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1787868942.696614:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868942.696927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.697734:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593664 00000100:00100000:3.0:1787868942.697748:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593664 00000100:00100000:3.0:1787868942.697797:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918593792 00000100:00100000:3.0:1787868942.697801:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918593792 00000100:00100000:3.0:1787868942.697837:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868942.697846:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874715918593664:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787868942.697899:0:19034:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from f24169c3-92a7-4501-a36f-f9f115268206@192.168.204.27@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:3.0:1787868942.697954:0:19034:0:(genops.c:1385:class_connect()) connect: client f24169c3-92a7-4501-a36f-f9f115268206, cookie 0x2f11f4d3bde2e6a4 00002000:00100000:3.0:1787868942.697970:0:19034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f24169c3-92a7-4501-a36f-f9f115268206/ffff93d988919800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1787868942.698619:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1787868942.698631:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1874715918593792:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787868942.698663:0:18597:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from f24169c3-92a7-4501-a36f-f9f115268206@192.168.204.27@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1787868942.698690:0:18597:0:(genops.c:1385:class_connect()) connect: client f24169c3-92a7-4501-a36f-f9f115268206, cookie 0x2f11f4d3bde2e6ab 00002000:00100000:1.0:1787868942.698698:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f24169c3-92a7-4501-a36f-f9f115268206/ffff93d981c0b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787868942.698710:0:18597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787868942.698839:0:18597:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787868942.698881:0:18597:0:(import.c:65:import_set_state_nolock()) ffff93d981c09800 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1787868942.699407:0:19034:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787868942.699478:0:19034:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787868942.699503:0:19034:0:(import.c:65:import_set_state_nolock()) ffff93d98891f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787868942.699610:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+6:2402:x1874715918593664:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 1761us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.699622:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868942.708782:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2402:x1874715918593792:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 10127us (11831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868942.708805:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868942.713228:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868942.713414:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594048 00000100:00100000:3.0:1787868942.713430:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594048 00000100:00100000:3.0:1787868942.713510:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1787868942.713524:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918594048:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787868942.713655:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787868942.713776:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f24169c3-92a7-4501-a36f-f9f115268206+6:15040:x1874715918594048:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 254us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868942.713796:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000040:00080000:3.0:1787868942.754809:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787868943.037378:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868943.037459:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594176 00000100:00100000:0.0:1787868943.037474:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594176 00000100:00100000:0.0:1787868943.037616:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787868943.037631:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:15073:x1874715918594176:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:0.0:1787868943.037663:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868943.037706:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2e6b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff41b expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.037837:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.037866:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.037902:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868943.037968:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868943.037974:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868943.038003:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.038051:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2e6b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.038080:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868943.038101:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:0.0:1787868943.038105:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868943.038109:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1ca00, rc 0) 00000100:00100000:0.0:1787868943.038296:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+7:15073:x1874715918594176:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 668us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868943.041998:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:1.0:1787868943.267338:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868944.161565:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939651200:0@lo:400:kworker.0 00000100:00100000:2.0:1787868944.161667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868944.161759:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651200 00000100:00100000:2.0:1787868944.161768:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651200 00000100:00100000:3.0:1787868944.162607:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868944.162626:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939651328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868944.162682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.162722:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651328 00000100:00100000:3.0:1787868944.162727:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651328 00000100:00100000:3.0:1787868944.162786:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787868944.162798:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939651328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868944.162838:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868944.162904:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939651328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.162912:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787868944.162939:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868944.162983:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939651328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868944.163043:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939651456:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163143:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868944.163149:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939651840:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163206:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163239:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651840 00000100:00100000:3.0:1787868944.163242:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651840 00000100:00100000:3.0:1787868944.163294:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868944.163302:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939651840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163339:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939651840:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.163365:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868944.163394:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939651840:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163423:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939651968:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163496:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868944.163503:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939652352:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163549:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652352 00000100:00100000:3.0:1787868944.163553:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652352 00000100:00100000:3.0:1787868944.163585:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868944.163591:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939652352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163626:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939652352:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.163632:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787868944.163647:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868944.163668:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939652352:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163699:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163740:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652480 00000100:00100000:3.0:1787868944.163744:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652480 00000100:00100000:3.0:1787868944.163768:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787868944.163775:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939652480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163805:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939652480:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.163811:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787868944.163833:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787868944.163853:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbf0c0 x1874715939652480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868944.163877:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163945:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651712:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.163975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.163993:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939652224:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.164025:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939652736:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.164065:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787868944.164071:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651584:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.164105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939652096:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.164137:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939652608:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.164214:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651712 00000100:00100000:3.0:1787868944.164218:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651712 00000100:00100000:3.0:1787868944.164250:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651584 00000100:00100000:3.0:1787868944.164253:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651584 00000100:00100000:3.0:1787868944.164265:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652096 00000100:00100000:3.0:1787868944.164267:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652096 00000100:00100000:3.0:1787868944.164282:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868944.164288:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164323:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651712:12345-0@lo:400:kworker.0 Request processed in 36us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164336:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787868944.164348:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787868944.164354:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164384:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939651584:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164389:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787868944.164398:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868944.164405:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939652096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164426:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939652096:12345-0@lo:400:kworker.0 Request processed in 22us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164431:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787868944.164455:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652224 00000100:00100000:3.0:1787868944.164458:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652224 00000100:00100000:3.0:1787868944.164471:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652736 00000100:00100000:3.0:1787868944.164474:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652736 00000100:00100000:3.0:1787868944.164486:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652608 00000100:00100000:3.0:1787868944.164488:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652608 00000100:00100000:3.0:1787868944.164501:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868944.164506:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164534:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939652224:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164540:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868944.164551:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868944.164557:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939652736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164582:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939652736:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164602:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868944.164616:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787868944.164622:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939652608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164653:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939652608:12345-0@lo:400:kworker.0 Request processed in 31us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164659:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787868944.164682:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868944.164686:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868944.164689:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868944.164691:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868944.164717:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651584:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164731:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939652096:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164743:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939652608:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164752:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787868944.164768:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939651712:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164778:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939652224:0@lo:400:kworker.0 00010000:00080000:3.0:1787868944.164789:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbed00 x1874715939652736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868944.164799:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939652736:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164851:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651456 00000100:00100000:3.0:1787868944.164870:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651456 00000100:00100000:3.0:1787868944.164892:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939651968 00000100:00100000:3.0:1787868944.164896:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939651968 00000100:00100000:3.0:1787868944.164912:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868944.164927:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939651456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.164991:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939651456:12345-0@lo:400:kworker.0 Request processed in 66us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.164998:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787868944.165011:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787868944.165017:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.165044:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939651968:12345-0@lo:400:kworker.0 Request processed in 28us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.165050:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787868944.165080:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939651968:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.165091:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939651456:0@lo:400:kworker.0 00000100:00100000:1.0:1787868944.167254:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939652864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868944.167372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868944.167677:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652864 00000100:00100000:3.0:1787868944.167688:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652864 00000100:00100000:2.0:1787868944.167698:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787868944.167710:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939651200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.167737:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787868944.167743:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939652864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868944.167763:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868944.167786:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939651200:12345-0@lo:400:kworker.0 Request processed in 78us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868944.167794:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787868944.167885:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939651200:0@lo:400:kworker.0 00000100:00100000:3.0:1787868944.167920:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939652864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868944.167927:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787868944.167992:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939652864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787868944.305938:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787868944.676077:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000001:00100000:0.0:1787868944.676097:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00100000:2.0:1787868944.679459:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000001:00100000:2.0:1787868944.679476:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00100000:2.0:1787868944.682556:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000001:00100000:2.0:1787868944.682579:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00010000:00010000:0.0:1787868945.319580:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868946.209456:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868946.209486:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939652992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868946.209580:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868946.209677:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939652992 00000100:00100000:2.0:1787868946.209686:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939652992 00000100:00100000:2.0:1787868946.209750:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868946.209923:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939652992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868946.209960:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787868946.210016:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939652992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868946.210024:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787868946.210246:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868946.210286:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939652992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868946.210790:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939653120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868946.210838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868946.210935:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653120 00000100:00100000:1.0:1787868946.210940:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653120 00000100:00100000:1.0:1787868946.210983:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787868946.210991:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939653120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868946.211016:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787868946.211072:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939653120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868946.211079:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787868946.211367:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868946.211394:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939653120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787868946.345653:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868946.665020:0:19966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:1.0:1787868947.044646:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787868947.235602:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868947.235640:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939653248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868947.235751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868947.235968:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653248 00000100:00100000:1.0:1787868947.235979:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653248 00000100:00100000:1.0:1787868947.236048:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868947.236059:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939653248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868947.236106:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868947.236194:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939653248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868947.236203:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868947.236502:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939653248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868947.239139:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939653376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868947.239294:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868947.240458:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653376 00000100:00100000:1.0:1787868947.240476:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653376 00000100:00100000:1.0:1787868947.240577:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787868947.240591:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939653376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868947.240650:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787868947.245701:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939653376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5092us (6385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868947.245725:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787868947.250261:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939653376:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787868947.365319:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868948.211144:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211222:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211322:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211392:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211465:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868948.211507:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594304 00000100:00100000:0.0:1787868948.211516:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594304 00000100:00100000:0.0:1787868948.211575:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1787868948.211588:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918594304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.211669:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918594304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 86us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.211677:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1787868948.211716:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594560 00000100:00100000:0.0:1787868948.211720:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594560 00000100:00100000:0.0:1787868948.211760:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595072 00000100:00100000:0.0:1787868948.211763:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595072 00000100:00100000:0.0:1787868948.211789:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594432 00000100:00100000:0.0:1787868948.211793:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594432 00000100:00100000:0.0:1787868948.211813:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594944 00000100:00100000:0.0:1787868948.211816:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594944 00000100:00100000:0.0:1787868948.211849:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1787868948.212055:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212101:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 243us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212108:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1787868948.212127:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1787868948.212139:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918595072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212198:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918595072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 64us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212217:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1787868948.212233:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1787868948.212242:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918594432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212269:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918594432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212275:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1787868948.212291:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1787868948.212298:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918594944:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212319:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918594944:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212326:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1787868948.212347:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594816 00000100:00100000:0.0:1787868948.212350:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594816 00000100:00100000:0.0:1787868948.212375:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595328 00000100:00100000:0.0:1787868948.212378:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595328 00000100:00100000:0.0:1787868948.212391:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918594688 00000100:00100000:0.0:1787868948.212394:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918594688 00000100:00100000:0.0:1787868948.212413:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595200 00000100:00100000:0.0:1787868948.212415:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595200 00000100:00100000:0.0:1787868948.212433:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1787868948.212440:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212469:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212476:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1787868948.212490:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1787868948.212506:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918595328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212532:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918595328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212538:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1787868948.212548:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1787868948.212554:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594688:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212598:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918594688:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 44us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212604:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1787868948.212616:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1787868948.212622:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918595200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868948.212643:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918595200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868948.212648:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:0.0:1787868948.213297:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868948.213301:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868948.213304:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868948.213307:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787868948.385378:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787868948.776221:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000100:00100000:3.0:1787868949.281387:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868949.281423:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939653504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868949.281520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868949.281617:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653504 00000100:00100000:3.0:1787868949.281628:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653504 00000100:00100000:3.0:1787868949.281707:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787868949.281719:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939653504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868949.281771:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868949.282020:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939653504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 301us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868949.282030:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787868949.282059:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868949.282146:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939653504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868949.282397:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787868949.282410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939653632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868949.282452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868949.282489:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653632 00000100:00100000:3.0:1787868949.282494:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653632 00000100:00100000:3.0:1787868949.282528:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787868949.282536:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939653632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868949.282555:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868949.282588:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939653632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868949.282595:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787868949.282611:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868949.282645:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939653632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868949.283267:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939654016:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283403:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939654144:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.283482:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939654656:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.283554:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868949.283560:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939653760:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.283623:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939654272:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.283668:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939654784:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.283692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.283741:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654144 00000100:00100000:1.0:1787868949.283747:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654144 00000100:00100000:1.0:1787868949.284054:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654656 00000100:00100000:1.0:1787868949.284060:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654656 00000100:00100000:1.0:1787868949.284113:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654784 00000100:00100000:1.0:1787868949.284117:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654784 00000100:00100000:1.0:1787868949.284138:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787868949.284146:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939654144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284237:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939654144:12345-0@lo:400:kworker.0 Request processed in 91us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.284244:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787868949.284265:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868949.284271:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939654656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284369:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939654656:12345-0@lo:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.284378:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787868949.284392:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787868949.284399:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939654784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284440:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939654784:12345-0@lo:400:kworker.0 Request processed in 42us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.284446:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787868949.284481:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939653888:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284512:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.284534:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939654400:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284560:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.284581:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939654912:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868949.284645:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654272 00000100:00100000:1.0:1787868949.284648:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654272 00000100:00100000:1.0:1787868949.284670:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653888 00000100:00100000:1.0:1787868949.284672:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653888 00000100:00100000:1.0:1787868949.284686:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868949.284693:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939654272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.284729:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939654272:12345-0@lo:400:kworker.0 Request processed in 37us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.284736:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868949.284747:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868949.284752:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989066d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939653888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.284909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868949.284944:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989055e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939654528:0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.284972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868949.284991:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939655040:0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.285020:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868949.285055:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939653760 00000100:00100000:2.0:1787868949.285071:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939653760 00000100:00100000:2.0:1787868949.285109:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787868949.285117:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939653760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.285151:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939653760:12345-0@lo:400:kworker.0 Request processed in 35us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868949.285174:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787868949.285208:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654400 00000100:00100000:2.0:1787868949.285212:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654400 00000100:00100000:2.0:1787868949.285244:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654016 00000100:00100000:2.0:1787868949.285248:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654016 00000100:00100000:2.0:1787868949.285269:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868949.285276:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939654400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285404:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989066d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939653888:12345-0@lo:400:kworker.0 Request processed in 650us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.285412:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868949.285436:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868949.285445:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285494:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939654016:12345-0@lo:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.285501:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787868949.285545:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939653760:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285562:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939654272:0@lo:400:kworker.0 00010000:00080000:1.0:1787868949.285580:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989054f00 x1874715939654784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868949.285592:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939654784:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285606:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939654144:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285620:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939654656:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285660:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654912 00000100:00100000:1.0:1787868949.285664:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654912 00000100:00100000:1.0:1787868949.285686:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939654528 00000100:00100000:1.0:1787868949.285689:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939654528 00000100:00100000:1.0:1787868949.285701:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655040 00000100:00100000:1.0:1787868949.285703:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655040 00000100:00100000:1.0:1787868949.285720:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868949.285726:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939654912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.285770:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939654912:12345-0@lo:400:kworker.0 Request processed in 44us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.285777:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787868949.286773:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868949.286860:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939654528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.286939:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939654528:12345-0@lo:400:kworker.0 Request processed in 153us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.286961:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787868949.286990:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868949.286998:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939655040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.287030:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939655040:12345-0@lo:400:kworker.0 Request processed in 34us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868949.287037:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868949.287095:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939653888:0@lo:400:kworker.0 00000100:00100000:1.0:1787868949.287113:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939654912:0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.287322:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939654400:12345-0@lo:400:kworker.0 Request processed in 2044us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868949.287335:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868949.287399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939654016:0@lo:400:kworker.0 00000100:00100000:2.0:1787868949.287414:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989055e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939654528:0@lo:400:kworker.0 00010000:00080000:2.0:1787868949.287429:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989054780 x1874715939655040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868949.287442:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939655040:0@lo:400:kworker.0 00000100:00080000:3.0:1787868949.287629:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787868949.287636:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868949.287640:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868949.287778:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939654400:0@lo:400:kworker.0 00010000:00010000:3.0:1787868949.409670:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868950.435099:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787868950.876980:0:20113:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef58b8db0 20000000:00000080:2.0:1787868950.877017:0:20113:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93dab52cf000 uarg=0000000000000000 20000000:01000000:2.0:1787868950.877081:0:20113:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787868950.877090:0:20113:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787868950.877096:0:20113:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787868950.880559:0:20114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787868950.880908:0:20113:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787868950.888606:0:20113:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787868950.888992:0:20113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889131:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889140:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889146:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889905:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889925:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889932:0:20113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.889941:0:20113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.890105:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.890125:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 12 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.890146:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655168:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868950.890386:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.890406:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 12 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.890416:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655296:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868950.890454:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.890462:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.891362:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655424:0@lo:104: 00000100:00100000:3.0:1787868950.891427:0:20113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868950.891593:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655424 00000100:00100000:2.0:1787868950.891604:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655424 00000100:00100000:2.0:1787868950.891677:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787868950.891779:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.891792:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 23 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.891801:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655552:0@lo:104: 00000100:00100000:2.0:1787868950.891896:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655424:12345-0@lo:104: 00010000:00010000:2.0:1787868950.891915:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.891984:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787868950.891991:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655424:12345-0@lo:104: Request processed in 102us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868950.892000:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787868950.892113:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868950.892121:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.892129:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868950.892134:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.892144:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868950.892151:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868950.892181:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787868950.892226:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.892255:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868950.892289:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.892387:0:20113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868950.892428:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.892438:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 23 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.892446:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655808:0@lo:104: 00000100:00100000:0.0:1787868950.892596:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655552 00000100:00100000:0.0:1787868950.892603:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655552 00000100:00100000:0.0:1787868950.892635:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787868950.892643:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655552:12345-0@lo:104: 00010000:00010000:0.0:1787868950.892653:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.892788:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868950.892815:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655552:12345-0@lo:104: Request processed in 172us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.892889:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787868950.892912:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868950.892918:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.892927:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868950.892930:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.892939:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868950.892947:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868950.892953:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787868950.892978:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.892984:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868950.892993:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.892999:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987286800/0x2f11f4d3bde2e39b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e3a2 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.893212:0:20113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868950.893254:0:20113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868950.893264:0:20113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 23 pid: 17081 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.893274:0:20113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939656064:0@lo:104: 00010000:00010000:2.0:1787868950.893390:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828cc00/0x2f11f4d3bde2e500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e507 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.893412:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868950.893415:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868950.893417:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868950.893442:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655808 00000100:00100000:2.0:1787868950.893446:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655808 00010000:00010000:0.0:1787868950.893594:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868950.893596:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868950.893598:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868950.893617:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868950.893626:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655808:12345-0@lo:104: 00010000:00010000:0.0:1787868950.893635:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868950.898514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939655680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868950.900219:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939655936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.904823:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787868950.904856:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939655808:12345-0@lo:104: Request processed in 11219us (11632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.904877:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787868950.904947:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868950.904957:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.904971:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868950.904977:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.904989:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868950.904997:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868950.905003:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787868950.905068:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.905075:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868950.905109:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.905145:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0a00/0x2f11f4d3bde2e35c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e363 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.905180:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868950.905182:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868950.905184:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868950.905206:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868950.905232:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939656192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868950.905296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868950.905368:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656192 00000100:00100000:0.0:1787868950.905378:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656192 00010000:00010000:0.0:1787868950.905418:0:18622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 24 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868950.905453:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787868950.905463:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:431a2c34-804b-46dd-9d1f-913354b6c612+24:3637:x1874715939656192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.905497:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868950.905503:0:18622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 24 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.905515:0:18622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 24 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.905544:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868950.905581:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:431a2c34-804b-46dd-9d1f-913354b6c612+24:3637:x1874715939656192:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.905591:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787868950.905641:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939656192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868950.909339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868950.909462:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868950.909511:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595456 00000100:00100000:0.0:1787868950.909523:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595456 00010000:00010000:0.0:1787868950.909581:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 13 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868950.909622:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595584 00000100:00100000:0.0:1787868950.909625:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595584 00010000:00010000:0.0:1787868950.909639:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 14 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868950.909664:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1787868950.909678:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:847e79f0-919e-4251-863a-9b10feb7d22a+14:2403:x1874715918595456:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.909699:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868950.909705:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 14 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.909721:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 14 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.909762:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868950.909830:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:847e79f0-919e-4251-863a-9b10feb7d22a+14:2403:x1874715918595456:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 155us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.909839:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1787868950.909859:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1787868950.909867:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918595584:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.909875:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868950.909899:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 13 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.909908:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 13 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.909918:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868950.909938:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918595584:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 72us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.909945:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1787868950.914203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868950.914387:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655680 00000100:00100000:0.0:1787868950.914400:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655680 00010000:00010000:0.0:1787868950.914453:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 24 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868950.914506:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787868950.914520:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939655680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.914543:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868950.914549:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 24 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.914565:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 24 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.914595:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868950.914654:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939655680:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.914663:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868950.914969:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939655680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868950.915273:0:20113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868950.915340:0:20113:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7efc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787868950.915366:0:20113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070600/0x2f11f4d3bde2e68f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ea expref: 12 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.915384:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655168:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868950.915399:0:20113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871400/0x2f11f4d3bde2e650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff37a expref: 11 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.915408:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655296:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868950.915421:0:20113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286600/0x2f11f4d3bde2e507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e500 expref: 23 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.915430:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655424:0@lo:104: 00000100:00100000:3.0:1787868950.915444:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655552:0@lo:104: 00010000:00010000:3.0:1787868950.915454:0:20113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2e363 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e35c expref: 22 pid: 17083 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.915462:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939655808:0@lo:104: 00000100:00100000:1.0:1787868950.919363:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656064 00000100:00100000:1.0:1787868950.919391:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656064 00000100:00100000:1.0:1787868950.919493:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787868950.919508:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939656064:12345-0@lo:104: 00010000:00010000:1.0:1787868950.919537:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.919698:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787868950.919706:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:431a2c34-804b-46dd-9d1f-913354b6c612+3:20113:x1874715939656064:12345-0@lo:104: Request processed in 202us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868950.919752:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787868950.919784:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787868950.919792:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.919801:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787868950.919806:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.919816:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787868950.919910:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787868950.919916:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787868950.919965:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.919973:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787868950.919997:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.920065:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0000/0x2f11f4d3bde2e34e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2e355 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.920092:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868950.920095:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868950.920097:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868950.920209:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939656320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868950.920289:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868950.920456:0:20113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20113:1874715939656064:0@lo:104: 00010000:00010000:3.0:1787868950.920514:0:20113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868950.923408:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656320 00000100:00100000:1.0:1787868950.923457:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656320 00010000:00010000:1.0:1787868950.923516:0:18622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 22 pid: 17081 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868950.923574:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787868950.923587:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:431a2c34-804b-46dd-9d1f-913354b6c612+22:3637:x1874715939656320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868950.923606:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868950.923612:0:18622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 22 pid: 17081 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.923627:0:18622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 22 pid: 17081 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.923657:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030600/0x2f11f4d3bde2e355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e34e expref: 22 pid: 17081 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868950.923683:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868950.923872:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:431a2c34-804b-46dd-9d1f-913354b6c612+21:3637:x1874715939656320:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868950.923881:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787868950.929239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868950.929467:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939655936 00000100:00100000:0.0:1787868950.929481:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939655936 00010000:00010000:0.0:1787868950.929537:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 21 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868950.929581:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787868950.929593:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939655936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868950.929613:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868950.929620:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 21 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929636:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 21 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929664:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2e3a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2e39b expref: 21 pid: 17082 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929689:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929701:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929723:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929743:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929752:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929783:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929791:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787868950.929796:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929807:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929849:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868950.929862:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868950.929933:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:431a2c34-804b-46dd-9d1f-913354b6c612+20:3639:x1874715939655936:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868950.929942:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787868950.930016:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939655936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787868950.930383:0:20113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.930394:0:20113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868950.930402:0:20113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb1600/0x2f11f4d3bde2e6c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868950.937150:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939656320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868951.329749:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868951.329783:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939656448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868951.329908:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868951.330541:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656448 00000100:00100000:1.0:1787868951.330554:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656448 00000100:00100000:3.0:1787868951.330764:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868951.330782:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939656576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868951.330824:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787868951.330840:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939656448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868951.330887:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787868951.330960:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868951.331806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868951.333057:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939656448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2211us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868951.333074:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787868951.333116:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656576 00000100:00100000:1.0:1787868951.333146:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656576 00000100:00100000:1.0:1787868951.333710:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787868951.333733:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939656576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868951.333775:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787868951.333826:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939656448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868951.333871:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939656576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868951.333879:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787868951.333938:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939656576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787868951.336960:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787868951.457743:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868952.353972:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787868952.354003:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939656704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868952.354103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868952.354191:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656704 00000100:00100000:1.0:1787868952.354199:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656704 00000100:00100000:1.0:1787868952.354248:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868952.354259:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939656704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868952.354296:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868952.354347:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939656704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868952.354355:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787868952.354406:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939656704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868952.356499:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868952.356521:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939656832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868952.356609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868952.356804:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656832 00000100:00100000:1.0:1787868952.356814:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656832 00000100:00100000:1.0:1787868952.356864:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787868952.356874:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939656832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868952.358649:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787868952.358830:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939656832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1953us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868952.358849:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787868952.368490:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939656832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787868952.485487:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868952.545585:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868952.546936:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595712 00000100:00100000:2.0:1787868952.546953:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595712 00000100:00100000:2.0:1787868952.547031:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:2.0:1787868952.547042:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+11:14923:x1874715918595712:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868952.547061:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868952.547083:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2e6c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff422 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.547116:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2e6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff422 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.547128:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2e6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff422 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.547138:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871e00, rc 0) 00000100:00100000:2.0:1787868952.547234:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918595712:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 194us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.547243:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:3.0:1787868952.551080:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868952.551942:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595840 00000100:00100000:1.0:1787868952.551954:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595840 00000100:00100000:1.0:1787868952.552016:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:1.0:1787868952.552028:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918595840:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868952.552224:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918595840:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 197us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868952.552232:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:0.0:1787868952.557032:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868952.557291:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918595968 00000100:00100000:3.0:1787868952.557302:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918595968 00000100:00100000:3.0:1787868952.557349:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:3.0:1787868952.557358:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918595968:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.557502:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918595968:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 144us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868952.557511:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:1.0:1787868952.573607:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868952.573667:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596096 00000100:00100000:2.0:1787868952.573680:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596096 00000100:00100000:2.0:1787868952.573754:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:2.0:1787868952.573766:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+12:14923:x1874715918596096:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868952.573786:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868952.573806:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2e6ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff429 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.573837:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2e6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff429 expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.573858:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2e6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff429 expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.573868:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870200, rc 0) 00000100:00100000:2.0:1787868952.573934:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:14923:x1874715918596096:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 170us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.573942:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:2.0:1787868952.577799:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868952.577884:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596224 00000100:00100000:3.0:1787868952.577894:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596224 00000100:00100000:3.0:1787868952.577955:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:3.0:1787868952.577965:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:14923:x1874715918596224:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.578357:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:14923:x1874715918596224:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 392us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868952.578367:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:1.0:1787868952.603905:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868952.604014:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596352 00000100:00100000:3.0:1787868952.604024:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596352 00000100:00100000:3.0:1787868952.604075:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:3.0:1787868952.604086:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:14923:x1874715918596352:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.604271:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:14923:x1874715918596352:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 186us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868952.604285:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 10000000:01000000:2.0:1787868952.739674:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787868952.739683:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9871e8000 from 13 10000000:01000000:2.0:1787868952.739700:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787868952.739763:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.739776:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.739797:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868952.739829:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939656960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.739970:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868952.740134:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868952.740377:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939656960 00000100:00100000:0.0:1787868952.740385:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939656960 00000100:00100000:0.0:1787868952.740443:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868952.740452:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+20:17085:x1874715939656960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868952.740465:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868952.740477:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1c400/0x2f11f4d3bde2e6dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e6d5 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.740498:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1c400/0x2f11f4d3bde2e6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6d5 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.740508:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1c400/0x2f11f4d3bde2e6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6d5 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.740518:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1c400, rc 0) 00000100:00100000:0.0:1787868952.740561:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab72c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939656960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868952.740569:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787868952.740610:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939656960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868952.740623:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.740632:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868952.740706:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.740750:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.740770:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868952.740783:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657088 00000100:00100000:0.0:1787868952.740948:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657088 00000100:00100000:0.0:1787868952.741046:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787868952.741054:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939657088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.741185:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da99f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939657088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868952.741193:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787868952.741223:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.741251:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.741286:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.741298:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787868952.741439:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657216 00000100:00100000:3.0:1787868952.741444:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657216 00000100:00100000:3.0:1787868952.741477:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787868952.741484:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939657216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.741565:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939657216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868952.741572:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787868952.741719:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787868952.756766:0:20167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787868952.757269:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787868952.757297:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787868952.757308:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.757321:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868952.757332:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787868952.757335:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93da82b4f800 from 13 10000000:01000000:3.0:1787868952.757337:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868952.757371:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.757380:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.757390:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868952.757415:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.757493:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868952.757539:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044780 going to sleep for 11 seconds 00000100:00100000:0.0:1787868952.757613:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657344 00000100:00100000:0.0:1787868952.757621:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657344 00000100:00100000:0.0:1787868952.757723:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787868952.757734:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+21:17085:x1874715939657344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868952.757748:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868952.757763:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2e6ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e6e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.757800:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2e6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6e3 expref: 22 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.757811:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2e6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6e3 expref: 22 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.757818:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d800, rc 0) 00000100:00100000:1.0:1787868952.758112:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787868952.758127:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868952.758136:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868952.758215:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787868952.758246:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.758294:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868952.758311:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787868952.758407:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9881a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787868952.760236:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657472 00000100:00100000:0.0:1787868952.760249:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657472 00000100:00100000:0.0:1787868952.760285:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787868952.760293:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.760448:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868952.760456:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787868952.760607:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.760671:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.760735:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868952.760812:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868952.761098:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657600 00000100:00100000:3.0:1787868952.761103:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657600 00000100:00100000:1.0:1787868952.761196:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787868952.761208:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787868952.761296:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da897ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868952.761309:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787868952.761889:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989056940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787868952.763201:0:20169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787868952.763364:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787868952.763390:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787868952.763401:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.763413:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868952.763424:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787868952.763427:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab7ec9800 from 13 10000000:01000000:3.0:1787868952.763430:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787868952.763464:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.763472:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.763482:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868952.763502:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.763560:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868952.763605:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.763729:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657728 00000100:00100000:2.0:1787868952.763735:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657728 00000100:00100000:2.0:1787868952.763778:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787868952.763797:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+22:17085:x1874715939657728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868952.763810:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868952.763822:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2e6f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e6f1 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.763846:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2e6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6f1 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.763856:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2e6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6f1 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.763972:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:2.0:1787868952.764079:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939657728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.764086:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787868952.764206:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787868952.764222:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868952.764246:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868952.764320:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.764345:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868952.764361:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.764461:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657856 00000100:00100000:2.0:1787868952.764466:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657856 00000100:00100000:2.0:1787868952.764485:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787868952.764491:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939657856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.764603:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939657856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.764610:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787868952.765456:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.765498:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787868952.765547:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868952.765586:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987044cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.766351:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939657984 00000100:00100000:2.0:1787868952.766359:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939657984 00000100:00100000:2.0:1787868952.766397:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787868952.766405:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939657984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.766514:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939657984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.766521:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787868952.767475:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939657984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787868952.771770:0:20170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787868952.773755:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787868952.773792:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868952.773804:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.773817:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868952.773829:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787868952.773832:0:17085:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93daa05e9800 from 13 10000000:01000000:0.0:1787868952.773835:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787868952.774964:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.774979:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.774992:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868952.775021:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.775097:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.775144:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.775277:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658112 00000100:00100000:2.0:1787868952.775285:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658112 00000100:00100000:2.0:1787868952.775341:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787868952.775352:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+23:17085:x1874715939658112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787868952.775366:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868952.775383:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2e706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2e6ff expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.775406:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6ff expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.775417:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6ff expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868952.775426:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870800, rc 0) 00000100:00100000:2.0:1787868952.775467:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939658112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.775474:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787868952.775555:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787868952.775568:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.775577:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868952.776599:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.776736:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.776780:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.776984:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658240 00000100:00100000:2.0:1787868952.776990:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658240 00000100:00100000:2.0:1787868952.777033:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787868952.777048:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939658240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.777212:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939658240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.777219:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787868952.777332:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.777374:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787868952.777425:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868952.777443:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787868952.777741:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658368 00000100:00100000:2.0:1787868952.777745:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658368 00000100:00100000:2.0:1787868952.781232:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787868952.781253:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939658368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787868952.781451:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:17085:x1874715939658368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868952.781459:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787868952.781622:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:431a2c34-804b-46dd-9d1f-913354b6c612:17085:1874715939658368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787868952.782367:0:20172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787868952.782440:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787868952.782458:0:17085:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787868952.782470:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868952.782480:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868952.993992:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787868953.312934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.312977:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.312999:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.313018:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.313050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.313069:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.313091:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868953.313910:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596480 00000100:00100000:3.0:1787868953.313922:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596480 00000100:00100000:3.0:1787868953.313981:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1787868953.313992:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2406:x1874715918596480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868953.314065:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2406:x1874715918596480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 75us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868953.314072:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:0.0:1787868953.317063:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596864 00000100:00100000:0.0:1787868953.317080:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596864 00000100:00100000:0.0:1787868953.317166:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597376 00000100:00100000:0.0:1787868953.317170:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597376 00000100:00100000:0.0:1787868953.317187:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596992 00000100:00100000:0.0:1787868953.317190:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596992 00000100:00100000:0.0:1787868953.317211:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1787868953.317221:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317295:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 75us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317302:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1787868953.317318:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868953.317325:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317349:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317355:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787868953.317366:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1787868953.317373:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daad242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317408:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daad242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317415:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00080000:0.0:1787868953.317538:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787868953.317542:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868953.317644:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596608 00000100:00100000:0.0:1787868953.317648:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596608 00000100:00100000:0.0:1787868953.317675:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597120 00000100:00100000:0.0:1787868953.317688:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597120 00000100:00100000:0.0:1787868953.317702:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918596736 00000100:00100000:0.0:1787868953.317705:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918596736 00000100:00100000:0.0:1787868953.317718:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1787868953.317725:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2406:x1874715918596608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317753:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2406:x1874715918596608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (4832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317760:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1787868953.317772:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1787868953.317789:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2406:x1874715918597120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317809:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2406:x1874715918597120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317815:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1787868953.317825:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1787868953.317830:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.317847:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2406:x1874715918596736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 17us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.317872:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00080000:0.0:1787868953.317886:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868953.317888:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868953.321876:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.321939:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868953.321974:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597504 00000100:00100000:0.0:1787868953.321983:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597504 00000100:00100000:0.0:1787868953.322045:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1787868953.322056:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868953.322748:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597248 00000100:00100000:3.0:1787868953.322755:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597248 00000100:00100000:3.0:1787868953.322810:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1787868953.322818:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868953.322916:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 861us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868953.322924:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00080000:0.0:1787868953.322952:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868953.322956:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868953.337438:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2406:x1874715918597248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 14609us (15559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868953.337453:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00010000:00010000:3.0:1787868953.505756:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868954.401571:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939658496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868954.401670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868954.401928:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658496 00000100:00100000:3.0:1787868954.401936:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658496 00000100:00100000:3.0:1787868954.402010:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787868954.402019:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939658496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787868954.402050:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868954.402091:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939658496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868954.402099:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787868954.402269:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787868954.402321:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939658752:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402351:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402378:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939659264:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402417:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989065e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939659776:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402437:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402454:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787868954.402458:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939658880:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402488:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939659392:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402529:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939659904:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402579:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659776 00000100:00100000:2.0:1787868954.402583:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659776 00000100:00100000:2.0:1787868954.402610:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659904 00000100:00100000:2.0:1787868954.402613:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659904 00000100:00100000:2.0:1787868954.402626:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787868954.402632:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939659776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402681:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939659776:12345-0@lo:400:kworker.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.402687:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787868954.402699:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868954.402705:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939659904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402730:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939659904:12345-0@lo:400:kworker.0 Request processed in 25us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.402736:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787868954.402751:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939658624:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402797:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939659136:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402824:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939659648:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402865:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787868954.402870:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939659008:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402899:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939659520:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.402932:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939660032:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.402946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868954.403082:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658624 00000100:00100000:2.0:1787868954.403086:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658624 00000100:00100000:2.0:1787868954.403109:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787868954.403115:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403146:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939658624:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.403153:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787868954.403228:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9889e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939658496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868954.403249:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659136 00000100:00100000:2.0:1787868954.403252:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659136 00000100:00100000:2.0:1787868954.403264:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659648 00000100:00100000:2.0:1787868954.403266:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659648 00000100:00100000:2.0:1787868954.403277:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659520 00000100:00100000:2.0:1787868954.403279:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659520 00000100:00100000:2.0:1787868954.403286:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660032 00000100:00100000:2.0:1787868954.403289:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660032 00000100:00100000:2.0:1787868954.403300:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787868954.403305:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939659136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403330:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939659136:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.403335:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787868954.403344:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787868954.403348:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939659648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403369:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939659648:12345-0@lo:400:kworker.0 Request processed in 20us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.403380:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787868954.403390:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787868954.403394:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939659520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403416:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939659520:12345-0@lo:400:kworker.0 Request processed in 22us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.403421:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787868954.403429:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787868954.403434:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939660032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403453:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939660032:12345-0@lo:400:kworker.0 Request processed in 20us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868954.403458:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787868954.403479:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939659520:0@lo:400:kworker.0 00010000:00080000:2.0:1787868954.403490:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989067c00 x1874715939660032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868954.403500:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939660032:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403507:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939658624:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403515:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939659136:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403523:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939659648:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.403552:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939659904:0@lo:400:kworker.0 00010000:00080000:2.0:1787868954.403562:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d989065e00 x1874715939659776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868954.403570:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989065e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939659776:0@lo:400:kworker.0 00000100:00100000:1.0:1787868954.403669:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658752 00000100:00100000:1.0:1787868954.403673:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658752 00000100:00100000:1.0:1787868954.403695:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659264 00000100:00100000:1.0:1787868954.403697:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659264 00000100:00100000:1.0:1787868954.403709:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868954.403715:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939658752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868954.403759:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939658752:12345-0@lo:400:kworker.0 Request processed in 43us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868954.403764:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787868954.403775:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787868954.403779:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939659264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868954.403801:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939659264:12345-0@lo:400:kworker.0 Request processed in 22us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868954.403806:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787868954.403819:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868954.403823:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868954.404021:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939658880 00000100:00100000:0.0:1787868954.404025:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939658880 00000100:00100000:0.0:1787868954.404052:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659392 00000100:00100000:0.0:1787868954.404054:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659392 00000100:00100000:0.0:1787868954.404066:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939659008 00000100:00100000:0.0:1787868954.404068:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939659008 00000100:00100000:0.0:1787868954.404080:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787868954.404085:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939658880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868954.404116:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939658880:12345-0@lo:400:kworker.0 Request processed in 32us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868954.404122:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787868954.404132:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787868954.404137:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868954.404190:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939659392:12345-0@lo:400:kworker.0 Request processed in 53us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868954.404197:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787868954.404207:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868954.404211:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939659008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868954.404234:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939659008:12345-0@lo:400:kworker.0 Request processed in 23us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868954.404240:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787868954.404260:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868954.404268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939660160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868954.404293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868954.404615:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868954.404619:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868954.404642:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939659008:0@lo:400:kworker.0 00000100:00100000:3.0:1787868954.404734:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660160 00000100:00100000:3.0:1787868954.404739:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660160 00000100:00100000:3.0:1787868954.404778:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787868954.404785:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939660160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868954.404798:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868954.404841:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939660160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868954.404846:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787868954.404911:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939660160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787868954.405221:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939658880:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.405232:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939659392:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.405242:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939658752:0@lo:400:kworker.0 00000100:00100000:2.0:1787868954.405251:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939659264:0@lo:400:kworker.0 00010000:00010000:0.0:1787868954.531272:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868955.337295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.338459:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597632 00000100:00100000:2.0:1787868955.338471:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597632 00000100:00100000:2.0:1787868955.338549:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1787868955.338561:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:15590:x1874715918597632:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868955.338581:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787868955.338763:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787868955.338803:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff430 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338869:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338883:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338896:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338972:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338981:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.338988:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339075:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339084:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339091:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868955.339120:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868955.339124:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868955.339191:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339203:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339209:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339216:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339223:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.339227:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339235:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339247:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:2.0:1787868955.339254:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.339260:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339267:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339281:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339870:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339878:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339884:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.339888:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339894:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339904:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93daafdb5900) 00010000:00010000:2.0:1787868955.339906:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.339909:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.339976:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e71b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.340014:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff430 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.340039:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff430 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.340047:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93daafdb5a00) 00010000:00010000:2.0:1787868955.340049:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868955.340052:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870c00, rc 0) 00000100:00100000:2.0:1787868955.340145:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15590:x1874715918597632:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1587us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868955.340236:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1787868955.359935:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.361686:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918597760 00000100:00100000:3.0:1787868955.361700:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918597760 00000100:00100000:3.0:1787868955.361839:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1787868955.361851:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15590:x1874715918597760:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787868955.361993:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15590:x1874715918597760:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 145us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868955.362015:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868955.371689:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.372018:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598016 00000100:00100000:3.0:1787868955.372028:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598016 00000100:00100000:3.0:1787868955.372082:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787868955.372091:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15590:x1874715918598016:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787868955.372111:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868955.372136:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e729 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff437 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.372237:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.372253:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.372266:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373039:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373052:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373060:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373183:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2e73e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373209:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2e73e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.373216:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2e73e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868955.373228:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787868955.373997:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374007:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374014:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374021:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868955.374025:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374032:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374044:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93daafdb5a00) 00010000:00010000:3.0:1787868955.374047:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.374051:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374058:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e730 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374071:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374083:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374088:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374093:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868955.374095:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374101:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374108:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93da93866200) 00010000:00010000:3.0:1787868955.374110:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.374113:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.374119:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e737 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.375284:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e729 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff437 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.375318:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2e73e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff437 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.375327:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da93866c00) 00010000:00010000:3.0:1787868955.375330:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.375340:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1600, rc 0) 00000100:00100000:3.0:1787868955.375427:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15590:x1874715918598016:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 3336us (3757us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787868955.375437:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1787868955.381969:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.382069:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598144 00000100:00100000:2.0:1787868955.382080:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598144 00000100:00100000:2.0:1787868955.382233:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1787868955.382245:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15590:x1874715918598144:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787868955.382365:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989065e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15590:x1874715918598144:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 122us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868955.382376:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1787868955.388152:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.388286:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598272 00000100:00100000:3.0:1787868955.388308:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598272 00000100:00100000:3.0:1787868955.388420:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1787868955.388435:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15590:x1874715918598272:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787868955.388601:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787868955.389507:0:17088:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1008us 00000100:00100000:3.0:1787868955.404514:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15590:x1874715918598272:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 16073us (16361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868955.404528:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1787868955.423323:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.427516:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598400 00000100:00100000:3.0:1787868955.427544:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598400 00000100:00100000:2.0:1787868955.435628:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787868955.435655:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15596:x1874715918598400:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868955.435898:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868955.435922:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e74c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff43e expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.435989:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436017:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436029:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436045:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436053:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436059:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436100:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436108:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436116:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436122:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.436127:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436135:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436147:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:2.0:1787868955.436187:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.436193:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436200:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436217:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436223:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436230:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436235:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.436238:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436245:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436253:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93daafdb5900) 00010000:00010000:2.0:1787868955.436255:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.436258:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436264:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e75a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436819:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e74c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff43e expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436839:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:2.0:1787868955.436841:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.436846:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e74c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff43e expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.436855:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868955.436928:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15596:x1874715918598400:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1287us (13623us total) trans 0 rc 301/301 00000100:00100000:2.0:1787868955.436936:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1787868955.447906:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.451660:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598528 00000100:00100000:0.0:1787868955.451684:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598528 00000100:00100000:0.0:1787868955.453338:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868955.453361:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15596:x1874715918598528:12345-192.168.204.27@tcp:700:lfs.0 00000100:00100000:0.0:1787868955.453467:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:15596:x1874715918598528:12345-192.168.204.27@tcp:700:lfs.0 Request processed in 116us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868955.455782:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.455910:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598784 00000100:00100000:2.0:1787868955.455920:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598784 00000100:00100000:2.0:1787868955.455981:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1787868955.455991:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+10:15596:x1874715918598784:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1787868955.456044:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868955.456072:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dac2071000/0x2f11f4d3bde2e67a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3ab expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.456094:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:2.0:1787868955.456099:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868955.456184:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.456199:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 5 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.456208:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.456253:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 5 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.456267:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 5 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868955.456282:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939660288:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868955.456369:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986c0bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787868955.459592:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1787868955.461922:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939660288:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868955.461954:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868955.468136:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868955.469904:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918598912 00000100:00100000:1.0:1787868955.469924:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918598912 00010000:00010000:1.0:1787868955.470031:0:18622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 6 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868955.470083:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1787868955.470097:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f24169c3-92a7-4501-a36f-f9f115268206+6:2403:x1874715918598912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868955.470117:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868955.470125:0:18622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 6 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470141:0:18622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 6 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470218:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1ca00/0x2f11f4d3bde2e6b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff41b expref: 6 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470252:0:18622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:1.0:1787868955.470258:0:18622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470270:0:18622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470279:0:18622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868955.470310:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868955.470406:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f24169c3-92a7-4501-a36f-f9f115268206+5:2403:x1874715918598912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 311us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868955.470416:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:2.0:1787868955.470447:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787868955.470923:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.470947:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.470979:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.471005:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.471014:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477767:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477814:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477831:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868955.477872:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000494a7e88 reply state 0000000058057bcb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477885:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477892:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:3.0:1787868955.477895:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868955.477899:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787868955.477905:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868955.477915:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477922:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477927:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477947:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868955.477951:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477958:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477969:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5e05400) 00010000:00010000:3.0:1787868955.477972:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.477975:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.477982:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e761 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787868955.478006:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000494a7e88 reply state 0000000058057bcb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.478015:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.478027:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93da93866200) 00010000:00010000:3.0:1787868955.478029:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868955.478032:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787868955.479343:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+10:15596:x1874715918598784:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 23343us (23557us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787868955.479356:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00010000:00010000:1.0:1787868955.553435:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868955.583428:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.583700:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599040 00000100:00100000:2.0:1787868955.583711:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599040 00000100:00100000:2.0:1787868955.583776:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1787868955.583787:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+10:15604:x1874715918599040:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:2.0:1787868955.583814:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868955.583837:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff445 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.583904:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.583918:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.583931:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868955.583972:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868955.583975:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868955.584026:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.586707:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff445 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.586743:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff445 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.586753:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:2.0:1787868955.586756:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868955.586760:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870400, rc 0) 00000100:00100000:2.0:1787868955.586839:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+11:15604:x1874715918599040:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 3053us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868955.586849:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1787868955.623395:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.623546:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599168 00000100:00100000:3.0:1787868955.623557:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599168 00000100:00100000:3.0:1787868955.623660:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1787868955.623671:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:15605:x1874715918599168:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868955.623705:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868955.623728:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff44c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625310:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625328:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625341:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868955.625388:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787868955.625393:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787868955.625412:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625439:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff44c expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625461:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff44c expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.625470:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:3.0:1787868955.625473:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787868955.625477:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0000, rc 0) 00000100:00100000:3.0:1787868955.625643:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:15605:x1874715918599168:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1965us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868955.625668:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1787868955.632811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.632911:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599296 00000100:00100000:2.0:1787868955.632920:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599296 00000100:00100000:2.0:1787868955.633007:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868955.633017:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+6:15605:x1874715918599296:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868955.633037:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868955.633057:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff453 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633119:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633132:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633201:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633216:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633223:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633231:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633310:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633318:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633325:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868955.633362:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787868955.633366:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868955.633387:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633400:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633407:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633423:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633429:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.633433:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633441:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633453:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:2.0:1787868955.633456:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.633460:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633466:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633477:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633483:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633488:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633491:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.633493:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633507:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633515:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93da93866200) 00010000:00010000:2.0:1787868955.633517:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.633520:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633861:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633890:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff453 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633904:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff453 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.633911:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868955.633913:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868955.633916:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868955.634020:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+7:15605:x1874715918599296:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1004us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868955.634028:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1787868955.641008:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868955.641247:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599424 00000100:00100000:1.0:1787868955.641257:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599424 00000100:00100000:1.0:1787868955.641333:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1787868955.641345:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f24169c3-92a7-4501-a36f-f9f115268206+5:15605:x1874715918599424:12345-192.168.204.27@tcp:900:lfs.0 00000100:00100000:1.0:1787868955.641435:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f24169c3-92a7-4501-a36f-f9f115268206+5:15605:x1874715918599424:12345-192.168.204.27@tcp:900:lfs.0 Request processed in 92us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868955.641443:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00080000:2.0:1787868955.642533:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868955.646329:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.646518:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599680 00000100:00100000:3.0:1787868955.646539:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599680 00000100:00100000:3.0:1787868955.646666:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1787868955.646691:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+7:15605:x1874715918599680:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868955.646712:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868955.646741:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff45a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868955.646844:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868955.646943:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff45a expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.646957:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:3.0:1787868955.646960:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868955.646965:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff45a expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.646978:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1c00, rc 0) 00000100:00100000:3.0:1787868955.647048:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989067c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+8:15605:x1874715918599680:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 362us (728us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787868955.647056:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1787868955.651835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.652108:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918599936 00000100:00100000:2.0:1787868955.652119:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918599936 00000100:00100000:2.0:1787868955.652210:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1787868955.652220:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+8:15605:x1874715918599936:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1787868955.652295:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868955.652325:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e7a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff453 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.652346:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868955.652351:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868955.652373:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.652387:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.652397:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868955.652669:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f640b88 reply state 00000000b0edd875 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.652682:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.652688:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868955.652691:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787868955.652693:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787868955.652700:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787868955.652942:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+9:15605:x1874715918599936:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 722us (1115us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787868955.652950:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1787868955.657801:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.657907:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918600192 00000100:00100000:0.0:1787868955.657918:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918600192 00000100:00100000:0.0:1787868955.658007:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1787868955.658018:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f24169c3-92a7-4501-a36f-f9f115268206+9:15605:x1874715918600192:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868955.658307:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f24169c3-92a7-4501-a36f-f9f115268206+10:15605:x1874715918600192:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 291us (574us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787868955.658316:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1787868955.662543:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.662688:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918600448 00000100:00100000:3.0:1787868955.662699:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918600448 00000100:00100000:3.0:1787868955.662765:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1787868955.662775:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+10:15605:x1874715918600448:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868955.662817:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868955.662840:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff461 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662915:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662930:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662941:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662952:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662959:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.662966:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868955.663063:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868955.663147:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663362:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663371:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663385:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868955.663389:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663396:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663408:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:3.0:1787868955.663412:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.663417:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663423:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e7ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663435:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663440:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663445:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663450:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787868955.663452:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663457:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663474:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93da93866200) 00010000:00010000:3.0:1787868955.663476:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787868955.663479:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868955.663485:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e7d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.665419:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff461 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.665439:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:0.0:1787868955.665442:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868955.665447:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e7c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff461 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.665463:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1c00, rc 0) 00000100:00100000:0.0:1787868955.665803:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+11:15605:x1874715918600448:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3027us (3281us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787868955.665812:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1787868955.671335:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.671407:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918600576 00000100:00100000:0.0:1787868955.671417:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918600576 00000100:00100000:0.0:1787868955.671475:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1787868955.671484:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+11:15605:x1874715918600576:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868955.671507:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868955.671538:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e7df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff468 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.671648:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.671663:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.671697:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868955.671724:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868955.671728:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868955.672410:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.672441:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e7df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.672460:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.672469:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:0.0:1787868955.672471:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868955.672475:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1dc00, rc 0) 00000100:00100000:0.0:1787868955.672541:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+12:15605:x1874715918600576:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1057us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868955.672548:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1787868955.676791:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868955.676897:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918600704 00000100:00100000:3.0:1787868955.676908:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918600704 00000100:00100000:3.0:1787868955.677047:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1787868955.677058:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f24169c3-92a7-4501-a36f-f9f115268206+12:15605:x1874715918600704:12345-192.168.204.27@tcp:37:lfs.0 00000100:00100000:3.0:1787868955.687152:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f24169c3-92a7-4501-a36f-f9f115268206+12:15605:x1874715918600704:12345-192.168.204.27@tcp:37:lfs.0 Request processed in 10086us (10476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868955.687252:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868955.694610:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.695226:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918600960 00000100:00100000:0.0:1787868955.695237:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918600960 00000100:00100000:0.0:1787868955.695300:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868955.695311:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986c12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f24169c3-92a7-4501-a36f-f9f115268206+12:15605:x1874715918600960:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868955.695585:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986c12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f24169c3-92a7-4501-a36f-f9f115268206+13:15605:x1874715918600960:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 268us (977us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787868955.695593:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1787868955.799400:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.799499:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601088 00000100:00100000:0.0:1787868955.799510:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601088 00000100:00100000:0.0:1787868955.799587:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787868955.799599:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+11:15611:x1874715918601088:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868955.799619:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868955.799652:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e7ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff46f expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799924:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799952:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799964:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799976:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799983:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.799989:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800071:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800082:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800106:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868955.800139:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787868955.800143:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868955.800222:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800235:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800242:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800248:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800254:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868955.800258:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800266:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800277:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:0.0:1787868955.800280:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868955.800291:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800297:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e7f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800321:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800327:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800332:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800337:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1d000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868955.800340:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800346:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800354:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93da93866200) 00010000:00010000:0.0:1787868955.800356:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868955.800359:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800364:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e7fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800389:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e7ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff46f expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800401:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff46f expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.800422:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:0.0:1787868955.800425:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787868955.800427:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d400, rc 0) 00000100:00100000:0.0:1787868955.800479:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:15611:x1874715918601088:12345-192.168.204.27@tcp:101:bash.0 Request processed in 883us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868955.800487:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787868955.803915:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868955.804076:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601216 00000100:00100000:1.0:1787868955.804086:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601216 00000100:00100000:1.0:1787868955.804141:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868955.804151:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15611:x1874715918601216:12345-192.168.204.27@tcp:900:bash.0 00000100:00100000:1.0:1787868955.804265:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15611:x1874715918601216:12345-192.168.204.27@tcp:900:bash.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868955.804273:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787868955.807004:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.807086:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601472 00000100:00100000:2.0:1787868955.807097:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601472 00000100:00100000:2.0:1787868955.807187:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1787868955.807198:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:15611:x1874715918601472:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868955.807217:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868955.807238:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e809 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff476 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.807369:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.807386:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.807395:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.807426:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.807438:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 12 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868955.807451:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939660416:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868955.807524:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8a70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868955.811423:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.811527:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988a83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939660416:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868955.811554:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868955.811870:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601600 00000100:00100000:0.0:1787868955.811878:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601600 00010000:00010000:0.0:1787868955.811916:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 13 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868955.811958:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1787868955.811968:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f24169c3-92a7-4501-a36f-f9f115268206+13:2404:x1874715918601600:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868955.811983:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868955.811989:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 13 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812002:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 13 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812024:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e7e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff468 expref: 13 pid: 17090 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812039:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:0.0:1787868955.812050:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812059:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812066:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.812093:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868955.812149:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f24169c3-92a7-4501-a36f-f9f115268206+12:2404:x1874715918601600:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 183us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868955.812193:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00010000:00010000:2.0:1787868955.812251:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812259:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812285:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812294:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812302:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812886:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812896:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812903:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868955.812914:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787868955.812939:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812945:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812952:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812962:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868955.812966:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812973:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812983:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868955.812985:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868955.812989:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.812995:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e810 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868955.813006:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000663843fc reply state 0000000034467c4f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.813016:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.813022:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93daafdb5300) 00010000:00010000:2.0:1787868955.813024:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868955.813026:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787868955.813056:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e809 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.813069:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.813085:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868955.813088:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787868955.813090:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871200, rc 0) 00000100:00100000:2.0:1787868955.813124:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:15611:x1874715918601472:12345-192.168.204.27@tcp:101:bash.0 Request processed in 5929us (6129us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787868955.813131:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:0.0:1787868955.837416:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868955.838113:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601728 00000100:00100000:2.0:1787868955.838125:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601728 00000100:00100000:2.0:1787868955.838226:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1787868955.838237:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:15611:x1874715918601728:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868955.838260:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868955.838280:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e82c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff47d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838350:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838364:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838375:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868955.838419:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787868955.838423:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868955.838441:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838468:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838497:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e82c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff47d expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838515:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff47d expref: 16 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868955.838524:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868955.838527:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868955.838531:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871600, rc 0) 00000100:00100000:2.0:1787868955.838603:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+16:15611:x1874715918601728:12345-192.168.204.27@tcp:101:bash.0 Request processed in 368us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868955.838610:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1787868955.848937:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.849077:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918601984 00000100:00100000:0.0:1787868955.849088:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918601984 00000100:00100000:0.0:1787868955.849148:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868955.849211:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+16:15611:x1874715918601984:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1787868955.849546:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+17:15611:x1874715918601984:12345-192.168.204.27@tcp:35:bash.0 Request processed in 388us (617us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787868955.849554:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1787868955.994430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868955.995019:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918602240 00000100:00100000:0.0:1787868955.995043:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918602240 00000100:00100000:0.0:1787868955.995111:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1787868955.995122:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+17:15621:x1874715918602240:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787868955.995355:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868955.995378:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e83a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff484 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868955.995494:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787868955.995597:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e83a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff484 expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.995611:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:0.0:1787868955.995614:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868955.995619:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e83a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff484 expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868955.995645:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1dc00, rc 0) 00000100:00100000:0.0:1787868955.995761:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+18:15621:x1874715918602240:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 641us (1343us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787868955.995769:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1787868956.005378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868956.005936:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918602496 00000100:00100000:0.0:1787868956.005946:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918602496 00000100:00100000:0.0:1787868956.006004:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1787868956.006014:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+18:15621:x1874715918602496:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868956.006276:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+19:15621:x1874715918602496:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 262us (907us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787868956.006284:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000040:00080000:3.0:1787868956.066274:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868956.101860:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868956.102228:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918602752 00000100:00100000:2.0:1787868956.102251:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918602752 00000100:00100000:2.0:1787868956.102313:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868956.102324:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+19:15624:x1874715918602752:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868956.102346:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868956.102368:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e848 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff48b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.102473:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e84f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.102509:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e84f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.102523:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e84f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868956.102536:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787868956.102662:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871a00/0x2f11f4d3bde2e848 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff48b expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.102681:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e84f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff48b expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.102691:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868956.102694:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868956.102698:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871c00, rc 0) 00000100:00100000:2.0:1787868956.102813:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15624:x1874715918602752:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 491us (962us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787868956.102821:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868956.119363:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868956.121447:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918602880 00000100:00100000:0.0:1787868956.121462:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918602880 00000100:00100000:0.0:1787868956.121538:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1787868956.121549:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15624:x1874715918602880:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1787868956.121637:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121669:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121683:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121729:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121736:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121742:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121747:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868956.121751:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121758:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121770:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868956.121773:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787868956.121777:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.121782:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e85d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868956.121867:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15624:x1874715918602880:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 320us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868956.121881:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1787868956.126269:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868956.126462:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918603136 00000100:00100000:3.0:1787868956.126473:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918603136 00000100:00100000:3.0:1787868956.126535:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868956.126547:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15624:x1874715918603136:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868956.126861:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+22:15624:x1874715918603136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 316us (600us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787868956.126886:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1787868956.141223:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868956.146471:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918603264 00000100:00100000:0.0:1787868956.146487:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918603264 00000100:00100000:0.0:1787868956.146561:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787868956.146571:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+22:2404:x1874715918603264:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868956.146589:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868956.146615:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871c00/0x2f11f4d3bde2e84f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff48b expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.146649:0:18622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868956.146654:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868956.146718:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:2404:x1874715918603264:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 148us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868956.146737:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000040:00080000:2.0:1787868956.258647:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868956.449476:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868956.449500:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939660544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868956.449580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868956.449735:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660544 00000100:00100000:2.0:1787868956.449743:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660544 00000100:00100000:2.0:1787868956.449807:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787868956.449818:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939660544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787868956.449847:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787868956.449916:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939660544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868956.449923:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787868956.450105:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939660544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787868956.450222:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868956.450399:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939660672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868956.450432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868956.450504:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660672 00000100:00100000:3.0:1787868956.450509:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660672 00000100:00100000:3.0:1787868956.450551:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787868956.450558:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939660672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787868956.450569:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787868956.450599:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939660672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868956.450606:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787868956.450719:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868956.450742:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939660672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787868956.577383:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868956.582447:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868956.582538:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918603520 00000100:00100000:3.0:1787868956.582547:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918603520 00000100:00100000:3.0:1787868956.582607:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1787868956.582630:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15655:x1874715918603520:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1787868956.582655:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868956.582675:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e864 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff492 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.582883:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e86b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.582898:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.582925:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868956.582950:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787868956.583080:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e864 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff492 expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.583099:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e86b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff492 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.583107:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868956.583110:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787868956.583113:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0c00, rc 0) 00000100:00100000:3.0:1787868956.583283:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+23:15655:x1874715918603520:12345-192.168.204.27@tcp:101:cat.0 Request processed in 666us (846us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787868956.583291:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1787868956.589586:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868956.589705:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918603648 00000100:00100000:1.0:1787868956.589728:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918603648 00000100:00100000:1.0:1787868956.589802:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1787868956.589829:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+23:2406:x1874715918603648:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787868956.589845:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868956.589871:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e86b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff492 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868956.589890:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868956.589895:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868956.589964:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+22:2406:x1874715918603648:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 138us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868956.589982:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1787868956.592073:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868956.592139:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918603904 00000100:00100000:3.0:1787868956.592148:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918603904 00000100:00100000:3.0:1787868956.592223:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868956.592232:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+22:15655:x1874715918603904:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:3.0:1787868956.592504:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+23:15655:x1874715918603904:12345-192.168.204.27@tcp:35:cat.0 Request processed in 272us (438us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787868956.592511:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868956.709589:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868956.709707:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918604160 00000100:00100000:2.0:1787868956.709727:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918604160 00000100:00100000:2.0:1787868956.709792:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1787868956.709803:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+23:15661:x1874715918604160:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1787868956.709828:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868956.709850:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e879 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff499 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.709965:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e880 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.709980:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.709992:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868956.710004:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787868956.710129:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e879 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff499 expref: 26 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.710150:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e880 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff499 expref: 25 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868956.710220:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868956.710236:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868956.710240:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d800, rc 0) 00000100:00100000:2.0:1787868956.710304:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15661:x1874715918604160:12345-192.168.204.27@tcp:101:dd.0 Request processed in 501us (723us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787868956.710311:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1787868956.730075:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868956.730119:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868956.730413:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918604288 00000100:00100000:3.0:1787868956.730424:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918604288 00000100:00100000:3.0:1787868956.730497:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1787868956.730507:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15661:x1874715918604288:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1787868956.730532:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868956.730552:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e88e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4a0 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730598:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730611:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730632:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730755:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e88e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 27 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730774:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 26 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868956.730783:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868956.730786:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787868956.730789:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0400, rc 0) 00000100:00100000:3.0:1787868956.730856:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+26:15661:x1874715918604288:12345-192.168.204.27@tcp:101:dd.0 Request processed in 351us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868956.730863:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1787868956.731866:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918604416 00000100:00100000:0.0:1787868956.731875:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918604416 00000100:00100000:0.0:1787868956.731938:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1787868956.731949:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+26:2405:x1874715918604416:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868956.731961:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868956.731989:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e880 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff499 expref: 26 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.732005:0:18622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868956.732009:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868956.732058:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:2405:x1874715918604416:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 111us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868956.732066:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1787868956.746116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868956.746314:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918604672 00000100:00100000:0.0:1787868956.746325:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918604672 00000100:00100000:0.0:1787868956.746384:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1787868956.746405:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15661:x1874715918604672:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:0.0:1787868956.746461:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868956.746491:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871600/0x2f11f4d3bde2e833 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff47d expref: 25 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.746510:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868956.746516:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787868956.746729:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.746742:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.746752:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787868956.746793:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787868956.746815:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b56cae1d reply state 00000000605a4cd2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.746836:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868956.746843:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868956.746845:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787868956.746848:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787868956.746950:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+27:15661:x1874715918604672:12345-192.168.204.27@tcp:36:dd.0 Request processed in 556us (843us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787868956.746958:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000020:00080000:0.0:1787868956.746963:0:17089:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787868956.895963:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868956.896049:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918604928 00000100:00100000:0.0:1787868956.896059:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918604928 00000100:00100000:0.0:1787868956.896119:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1787868956.896131:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+27:15661:x1874715918604928:12345-192.168.204.27@tcp:35:dd.0 00000100:00100000:0.0:1787868956.896404:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+28:15661:x1874715918604928:12345-192.168.204.27@tcp:35:dd.0 Request processed in 264us (439us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1787868956.896413:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000040:00080000:2.0:1787868957.282542:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787868957.405592:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868957.405718:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918605056 00000100:00100000:2.0:1787868957.405743:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918605056 00000100:00100000:2.0:1787868957.405849:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1787868957.405859:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+28:15675:x1874715918605056:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1787868957.405883:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868957.405918:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e8a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4a7 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.405995:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406010:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406021:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406032:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406039:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406058:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406143:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406152:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406186:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868957.406224:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787868957.406229:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868957.406277:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406289:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406297:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406303:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406309:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406315:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868957.406318:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406331:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406342:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868957.406345:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868957.406350:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406357:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e8aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406372:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406378:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406384:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406388:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828da00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868957.406391:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406397:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406403:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93daafdb5300) 00010000:00010000:2.0:1787868957.406406:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868957.406408:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406423:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e8b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406450:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e8a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a7 expref: 30 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406463:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a7 expref: 29 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868957.406470:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868957.406473:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868957.406475:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d800, rc 0) 00000100:00100000:2.0:1787868957.406541:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+29:15675:x1874715918605056:12345-192.168.204.27@tcp:101:stat.0 Request processed in 684us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868957.406548:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00080000:0.0:1787868957.406697:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787868957.473642:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988243c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939660800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787868957.473725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868957.473955:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660800 00000100:00100000:1.0:1787868957.473964:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660800 00000100:00100000:1.0:1787868957.474036:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787868957.474047:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939660800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868957.474085:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868957.474141:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939660800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868957.474149:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787868957.474369:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988243c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939660800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868957.475032:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868957.475057:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939660928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787868957.475105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868957.475191:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939660928 00000100:00100000:0.0:1787868957.475196:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939660928 00000100:00100000:0.0:1787868957.475239:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787868957.475247:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939660928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868957.475270:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787868957.475326:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939660928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868957.475332:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787868957.475515:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939660928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868957.531217:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868957.531392:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918605312 00000100:00100000:3.0:1787868957.531405:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918605312 00000100:00100000:3.0:1787868957.531477:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1787868957.531488:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+29:15681:x1874715918605312:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:3.0:1787868957.531550:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868957.531580:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e8b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a7 expref: 29 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.531614:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868957.531619:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787868957.531830:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.531845:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.531856:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787868957.531901:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787868957.531921:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c288f3b3 reply state 000000003bc00f20 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.531945:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.531951:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868957.531960:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787868957.531963:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868957.532075:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+31:15681:x1874715918605312:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 589us (868us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787868957.532083:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000020:00080000:3.0:1787868957.532087:0:17090:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787868957.601415:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868957.809667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868957.809908:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918605440 00000100:00100000:1.0:1787868957.809918:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918605440 00000100:00100000:1.0:1787868957.809997:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1787868957.810008:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+31:15695:x1874715918605440:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:1.0:1787868957.810033:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868957.810055:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2e8c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4ae expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810152:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810196:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810208:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810221:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810229:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810236:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810313:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810323:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810330:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787868957.810374:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787868957.810378:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787868957.810398:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810419:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810427:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810433:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810439:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810445:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868957.810449:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810457:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810469:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:1.0:1787868957.810472:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868957.810476:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810482:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2e8cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810495:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810501:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810515:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810521:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868957.810524:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810530:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810539:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93daafdb5300) 00010000:00010000:1.0:1787868957.810542:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868957.810545:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810551:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1aa00/0x2f11f4d3bde2e8d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810578:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2e8c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 33 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810612:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 32 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868957.810620:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868957.810622:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868957.810624:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a600, rc 0) 00000100:00100000:1.0:1787868957.812007:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+32:15695:x1874715918605440:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1992us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868957.812031:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1787868957.918019:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868957.918148:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918605696 00000100:00100000:3.0:1787868957.918178:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918605696 00000100:00100000:3.0:1787868957.918236:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1787868957.918245:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+32:15705:x1874715918605696:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787868957.918262:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868957.918280:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e8e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4b5 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787868957.918375:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787868957.918471:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e8e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4b5 expref: 34 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.918486:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:3.0:1787868957.918489:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787868957.918493:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e8e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4b5 expref: 34 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868957.918506:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0a00, rc 0) 00000100:00100000:3.0:1787868957.918573:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+33:15705:x1874715918605696:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 330us (564us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787868957.918581:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1787868957.921207:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868957.921429:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918605952 00000100:00100000:3.0:1787868957.921440:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918605952 00000100:00100000:3.0:1787868957.921487:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787868957.921497:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986c13450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+33:15705:x1874715918605952:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787868957.921895:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986c13450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+34:15705:x1874715918605952:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 398us (696us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787868957.921904:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1787868958.000493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.000624:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606208 00000100:00100000:0.0:1787868958.000634:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606208 00000100:00100000:0.0:1787868958.000703:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:0.0:1787868958.000714:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+34:15711:x1874715918606208:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868958.000739:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868958.000759:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e8f0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4bc expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000867:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000881:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000890:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000898:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000942:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.000956:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 35 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.000986:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939661056:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868958.001072:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.001080:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.001088:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98824e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939661184:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868958.001109:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787868958.008514:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939661056:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868958.008529:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98824e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1874715939661184:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868958.008570:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.018874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.018924:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.019060:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606336 00000100:00100000:2.0:1787868958.019069:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606336 00010000:00010000:2.0:1787868958.019110:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 36 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.019152:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606464 00000100:00100000:2.0:1787868958.019181:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606464 00010000:00010000:2.0:1787868958.019194:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 37 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.019226:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787868958.019248:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:2403:x1874715918606336:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868958.019264:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868958.019272:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 37 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019285:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 37 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019309:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a600/0x2f11f4d3bde2e8db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ae expref: 37 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019324:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.019330:0:17075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019338:0:17075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019345:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868958.019393:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+36:2403:x1874715918606336:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 146us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.019400:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787868958.019445:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787868958.019452:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+35:2403:x1874715918606464:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787868958.019460:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868958.019465:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019486:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019499:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871200/0x2f11f4d3bde2e81e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff476 expref: 35 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019509:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.019513:0:17075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019521:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.019528:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.020437:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787868958.020474:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+34:2403:x1874715918606464:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1020us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.020482:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00010000:00010000:0.0:1787868958.020870:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.020880:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868958.020901:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787868958.021040:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e8f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.021057:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 34 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.021073:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.021076:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787868958.021079:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d000, rc 0) 00000100:00100000:0.0:1787868958.021108:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+34:15711:x1874715918606208:12345-192.168.204.27@tcp:101:bash.0 Request processed in 20397us (20624us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787868958.021115:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1787868958.031662:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.031782:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606720 00000100:00100000:2.0:1787868958.031792:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606720 00000100:00100000:2.0:1787868958.031856:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1787868958.031867:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+34:15711:x1874715918606720:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:2.0:1787868958.032076:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.032094:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.032120:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787868958.032189:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1787868958.032210:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018909d89 reply state 000000005de1ae37 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.032223:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.032231:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.032234:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868958.032237:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868958.032316:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15711:x1874715918606720:12345-192.168.204.27@tcp:36:bash.0 Request processed in 451us (664us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1787868958.032324:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000020:00080000:2.0:1787868958.032328:0:17088:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787868958.035807:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.040788:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606848 00000100:00100000:0.0:1787868958.040803:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606848 00000100:00100000:0.0:1787868958.041011:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1787868958.041023:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15711:x1874715918606848:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868958.041048:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868958.041068:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e90c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4c3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.041126:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e90c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4c3 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.041142:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e90c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4c3 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.041175:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.041178:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787868958.041182:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1c600, rc 0) 00000100:00100000:0.0:1787868958.041294:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15711:x1874715918606848:12345-192.168.204.27@tcp:101:bash.0 Request processed in 273us (5616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.041317:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1787868958.050516:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.050908:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918606976 00000100:00100000:3.0:1787868958.050919:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918606976 00000100:00100000:3.0:1787868958.050987:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1787868958.050998:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15711:x1874715918606976:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787868958.051020:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787868958.051041:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e913 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4ca expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.051137:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.051153:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 39 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.051267:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.054258:0:17090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 39 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.054286:0:17090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 39 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.054304:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1874715939661312:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868958.054396:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5231780 going to sleep for 11 seconds 00000100:00100000:2.0:1787868958.058266:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1874715939661312:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868958.058296:0:17090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.058443:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.058652:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607104 00000100:00100000:3.0:1787868958.058659:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607104 00010000:00010000:3.0:1787868958.058703:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 40 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.058753:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1787868958.058764:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+40:2403:x1874715918607104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868958.058780:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868958.058786:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 40 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.058799:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 40 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.058822:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d000/0x2f11f4d3bde2e8f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4bc expref: 40 pid: 17089 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.059074:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868958.059080:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.059090:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.059098:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.059203:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868958.059260:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+39:2403:x1874715918607104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 497us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.059269:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00010000:00010000:2.0:1787868958.061518:0:17090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.061586:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868958.061658:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787868958.061663:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787868958.061743:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.061785:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e913 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ca expref: 39 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.061805:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ca expref: 38 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.061814:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.061817:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787868958.061821:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0a00, rc 0) 00000100:00100000:2.0:1787868958.062020:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15711:x1874715918606976:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11023us (11512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.062030:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1787868958.065520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.065638:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607360 00000100:00100000:1.0:1787868958.065648:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607360 00000100:00100000:1.0:1787868958.065769:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868958.065781:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15711:x1874715918607360:12345-192.168.204.27@tcp:103:bash.0 00010000:00010000:1.0:1787868958.065798:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787868958.065824:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c600/0x2f11f4d3bde2e90c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4c3 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.066837:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e91a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ca expref: 37 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.066849:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868958.066855:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787868958.066961:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+36:15711:x1874715918607360:12345-192.168.204.27@tcp:103:bash.0 Request processed in 1181us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868958.066970:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1787868958.070494:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.070650:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607488 00000100:00100000:2.0:1787868958.070660:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607488 00000100:00100000:2.0:1787868958.070818:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1787868958.070839:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+36:15711:x1874715918607488:12345-192.168.204.27@tcp:58:bash.0 00010000:00010000:2.0:1787868958.071040:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.071070:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.071083:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787868958.072217:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787868958.072461:0:17088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787868958.074114:0:17088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787868958.074248:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+36:15711:x1874715918607488:12345-192.168.204.27@tcp:58:bash.0 Request processed in 3416us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.074260:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1787868958.080978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.081054:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607616 00000100:00100000:0.0:1787868958.081065:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607616 00000100:00100000:0.0:1787868958.081126:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1787868958.081136:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+36:15711:x1874715918607616:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787868958.081174:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868958.081195:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4d1 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081249:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081261:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 37 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081279:0:17090:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081292:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 37 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081305:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.081307:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787868958.081311:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 37 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.081333:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d600, rc 0) 00000100:00100000:0.0:1787868958.081395:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15711:x1874715918607616:12345-192.168.204.27@tcp:101:bash.0 Request processed in 261us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.081403:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000040:00080000:3.0:1787868958.113385:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787868958.113408:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787868958.113441:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787868958.113450:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787868958.113609:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987c512c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17124:1874715939661440:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787868958.113814:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98727ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787868958.123431:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987c512c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17124:1874715939661440:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787868958.127441:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.127770:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607744 00000100:00100000:2.0:1787868958.127790:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607744 00000100:00100000:2.0:1787868958.127850:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1787868958.127878:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15712:x1874715918607744:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787868958.127958:0:17088:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787868958.128247:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15712:x1874715918607744:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 371us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.128255:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1787868958.135751:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.138628:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918607872 00000100:00100000:0.0:1787868958.138644:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918607872 00000100:00100000:0.0:1787868958.139258:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1787868958.139272:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15712:x1874715918607872:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787868958.139354:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139369:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139380:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139394:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139400:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139406:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139426:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139452:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139459:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868958.139503:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787868958.139507:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868958.139546:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139557:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139563:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139569:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139575:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1da00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.139579:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139595:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139607:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da93866c00) 00010000:00010000:0.0:1787868958.139610:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868958.139614:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139630:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1da00/0x2f11f4d3bde2e92f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139644:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139649:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139654:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139658:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.139661:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139666:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139672:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93da83a5f000) 00010000:00010000:0.0:1787868958.139674:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868958.139676:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139690:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1cc00/0x2f11f4d3bde2e936 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139705:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139710:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139722:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139728:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1de00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.139731:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139737:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139745:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.139747:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868958.139750:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.139756:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1de00/0x2f11f4d3bde2e93d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.139831:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15712:x1874715918607872:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 563us (4088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.139838:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1787868958.145930:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.147722:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918608128 00000100:00100000:2.0:1787868958.147735:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918608128 00000100:00100000:2.0:1787868958.147796:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1787868958.147806:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+37:15712:x1874715918608128:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868958.147826:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.147870:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4d8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.147973:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.147988:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148000:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868958.148012:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787868958.148093:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148101:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148108:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148114:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828da00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868958.148117:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148125:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148137:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.148140:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868958.148170:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148187:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828da00/0x2f11f4d3bde2e94b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148229:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e944 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d8 expref: 39 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148239:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da93866c00) 00010000:00010000:2.0:1787868958.148242:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868958.148246:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d8 expref: 39 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.148258:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:2.0:1787868958.148320:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15712:x1874715918608128:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 516us (2400us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787868958.148327:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1787868958.153623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.153701:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918608256 00000100:00100000:0.0:1787868958.153711:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918608256 00000100:00100000:0.0:1787868958.153770:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1787868958.153781:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15712:x1874715918608256:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787868958.153817:0:17088:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787868958.153940:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15712:x1874715918608256:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 153us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.153957:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1787868958.157407:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.157740:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918608512 00000100:00100000:0.0:1787868958.157749:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918608512 00000100:00100000:0.0:1787868958.157810:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1787868958.157820:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+38:15712:x1874715918608512:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868958.157839:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868958.157860:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e959 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4df expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787868958.158566:0:17088:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1787868958.158573:0:17088:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787868958.158602:0:17088:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787868958.159238:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ba00/0x2f11f4d3bde2e960 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.159254:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ba00/0x2f11f4d3bde2e960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.159266:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ba00/0x2f11f4d3bde2e960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.159322:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e959 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4df expref: 41 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.159341:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ba00/0x2f11f4d3bde2e960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4df expref: 40 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.159350:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05000) 00010000:00010000:1.0:1787868958.159353:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787868958.159356:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ba00, rc 0) 00000100:00100000:1.0:1787868958.159421:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+40:15712:x1874715918608512:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1602us (2025us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787868958.159430:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1787868958.162249:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.162373:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918608768 00000100:00100000:1.0:1787868958.162381:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918608768 00000100:00100000:1.0:1787868958.162433:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1787868958.162443:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+40:15712:x1874715918608768:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787868958.162495:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787868958.162519:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ba00/0x2f11f4d3bde2e960 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4df expref: 40 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162563:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05000) 00010000:00010000:1.0:1787868958.162575:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787868958.162607:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162620:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162629:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162641:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162648:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162654:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162701:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162708:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162713:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162719:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.162724:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162738:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162746:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:1.0:1787868958.162749:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.162752:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162758:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1a400/0x2f11f4d3bde2e96e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162767:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162774:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162780:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162784:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.162787:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162793:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162799:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb9fe0bbd (ffff93dab5e05c00) 00010000:00010000:1.0:1787868958.162801:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.162804:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.162818:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2e975 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9fe0bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.162884:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+39:15712:x1874715918608768:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 442us (642us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787868958.162892:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1787868958.165151:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.165318:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918608896 00000100:00100000:1.0:1787868958.165326:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918608896 00000100:00100000:1.0:1787868958.165379:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:1.0:1787868958.165389:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+39:15712:x1874715918608896:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787868958.165409:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787868958.165431:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b200/0x2f11f4d3bde2e97c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4e6 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165466:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2e983 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165479:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2e983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165491:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2e983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165666:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b200/0x2f11f4d3bde2e97c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4e6 expref: 41 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165909:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2e983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4e6 expref: 40 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.165941:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:1.0:1787868958.165944:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787868958.165947:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ac00, rc 0) 00000100:00100000:1.0:1787868958.166006:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+40:15712:x1874715918608896:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 617us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868958.166013:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1787868958.172856:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.172978:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918609152 00000100:00100000:3.0:1787868958.172990:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918609152 00000100:00100000:3.0:1787868958.173050:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1787868958.173060:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+40:15712:x1874715918609152:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787868958.173151:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.173185:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.173196:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787868958.173367:0:17088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787868958.173377:0:17088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 582299220345ns, next at 583299217800ns, rc = 0 00000004:00010000:3.0:1787868958.173422:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7e9c38a reply state 0000000012d97d5d transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.173434:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.173460:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:3.0:1787868958.173463:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787868958.173466:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787868958.173723:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+42:15712:x1874715918609152:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 662us (874us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787868958.173731:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1787868958.176040:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.176140:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918609280 00000100:00100000:2.0:1787868958.176192:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918609280 00000100:00100000:2.0:1787868958.176245:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1787868958.176255:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+42:15712:x1874715918609280:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868958.176277:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.176297:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4ed expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.176348:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 43 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.176362:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 43 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.176395:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:2.0:1787868958.176398:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868958.176402:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c800, rc 0) 00000100:00100000:2.0:1787868958.176448:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+43:15712:x1874715918609280:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 194us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.176455:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:0.0:1787868958.180216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.180338:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918609408 00000100:00100000:2.0:1787868958.180353:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918609408 00000100:00100000:2.0:1787868958.180432:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1787868958.180443:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2403:x1874715918609408:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787868958.181003:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2403:x1874715918609408:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 561us (795us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787868958.181011:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00080000:0.0:1787868958.182502:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868958.184547:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.184675:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918609664 00000100:00100000:3.0:1787868958.184744:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918609664 00000100:00100000:3.0:1787868958.184801:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787868958.184811:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+43:15712:x1874715918609664:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787868958.186097:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+44:15712:x1874715918609664:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 1282us (1563us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787868958.186108:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1787868958.189926:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.190270:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918609920 00000100:00100000:2.0:1787868958.190280:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918609920 00000100:00100000:2.0:1787868958.190377:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1787868958.190387:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+44:15712:x1874715918609920:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787868958.190561:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+44:15712:x1874715918609920:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 175us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.190568:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1787868958.194133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.194693:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610048 00000100:00100000:0.0:1787868958.194711:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610048 00000100:00100000:0.0:1787868958.194764:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1787868958.194774:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+44:15712:x1874715918610048:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787868958.194798:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787868958.194819:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c000/0x2f11f4d3bde2e998 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4f4 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.194886:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.194913:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.194925:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787868958.194972:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787868958.195003:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.195029:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c000/0x2f11f4d3bde2e998 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4f4 expref: 46 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.195046:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4f4 expref: 45 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.195055:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:0.0:1787868958.195058:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787868958.195061:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d200, rc 0) 00000100:00100000:0.0:1787868958.195128:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+45:15712:x1874715918610048:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 355us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.195136:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1787868958.199723:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.199836:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610176 00000100:00100000:2.0:1787868958.199846:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610176 00000100:00100000:2.0:1787868958.199895:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1787868958.199905:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2404:x1874715918610176:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868958.199936:0:18594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.199955:0:18594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff4fb expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868958.199978:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b71d, blocks: 0x0 00010000:00010000:2.0:1787868958.200091:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787868958.200096:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868958.200106:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 7 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.200125:0:18594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 7 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.200139:0:18594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828da00, rc 0) 00000100:00100000:2.0:1787868958.200328:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2404:x1874715918610176:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 424us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.200335:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787868958.203410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.203487:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610432 00000100:00100000:0.0:1787868958.203497:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610432 00000100:00100000:0.0:1787868958.203563:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868958.203573:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+45:15712:x1874715918610432:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787868958.203700:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9889e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+45:15712:x1874715918610432:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 128us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.203723:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1787868958.206853:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.206929:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610560 00000100:00100000:1.0:1787868958.206937:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610560 00000100:00100000:1.0:1787868958.206995:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1787868958.207005:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+45:15712:x1874715918610560:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787868958.209672:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1787868958.209695:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787868958.209750:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787868958.209853:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209867:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209875:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209883:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.209887:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209896:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209913:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:0.0:1787868958.209916:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787868958.209921:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.209928:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871000/0x2f11f4d3bde2e7bc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210032:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210041:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210047:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210053:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210057:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210063:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210073:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93da93866200) 00010000:00010000:1.0:1787868958.210082:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210086:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210092:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2e768 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210111:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210117:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210123:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210128:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210131:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210137:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210187:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:1.0:1787868958.210191:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210195:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210201:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2e76f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210213:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210229:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210235:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210240:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210243:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210249:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210258:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93daafdb5300) 00010000:00010000:1.0:1787868958.210260:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210263:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210269:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd871400/0x2f11f4d3bde2e817 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210283:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210289:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210295:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210300:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210307:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210314:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210322:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868958.210325:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210328:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210334:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1dc00/0x2f11f4d3bde2e89c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210344:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210349:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210355:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210360:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210363:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210368:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210375:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868958.210377:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210386:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210392:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2e8bf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210403:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210409:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210415:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210420:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828ce00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210423:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210429:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210437:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:1.0:1787868958.210439:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868958.210442:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210448:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e905 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210461:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210467:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210479:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210483:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868958.210486:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210493:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210501:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:1.0:1787868958.210503:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787868958.210506:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.210511:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2e98a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.210656:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+14:15712:x1874715918610560:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 3647us (3805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868958.210666:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1787868958.211124:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868958.211152:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939661568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787868958.211228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868958.211340:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939661568 00000100:00100000:3.0:1787868958.211347:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939661568 00000100:00100000:3.0:1787868958.211402:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787868958.211411:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939661568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787868958.211529:0:18596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787868958.211533:0:18596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787868958.211535:0:18596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787868958.211537:0:18596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787868957 -> 1787868957 00002000:00010000:3.0:1787868958.211540:0:18596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787868958.211594:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939661568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (355us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787868958.211601:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1787868958.211642:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93dab7fbc780/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787868958.211648:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939661568:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787868958.211688:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868958.214850:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.214918:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610688 00000100:00100000:0.0:1787868958.214941:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610688 00000100:00100000:0.0:1787868958.215006:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1787868958.215017:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2404:x1874715918610688:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787868958.215116:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2404:x1874715918610688:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.215123:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1787868958.218385:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.218463:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918610944 00000100:00100000:2.0:1787868958.218472:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918610944 00000100:00100000:2.0:1787868958.218523:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1787868958.218541:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+14:15712:x1874715918610944:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787868958.218600:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787868958.218625:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d200/0x2f11f4d3bde2e99f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4f4 expref: 14 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.218655:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:2.0:1787868958.218659:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787868958.218698:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.218711:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.218721:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868958.218843:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067749f48 reply state 000000000452db23 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.218855:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.218862:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:2.0:1787868958.218865:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787868958.218867:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787868958.218966:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:15712:x1874715918610944:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 426us (589us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787868958.218974:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1787868958.224480:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.224716:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611072 00000100:00100000:2.0:1787868958.224726:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611072 00000100:00100000:2.0:1787868958.224785:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787868958.224795:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15712:x1874715918611072:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787868958.224814:0:18596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.224843:0:18596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff502 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.225083:0:18596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 8 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.225092:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868958.225097:0:18596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868958.225102:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 8 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.225136:0:18596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 8 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.225151:0:18596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 8 pid: 18594 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.225186:0:18596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18596:1874715939661696:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787868958.225321:0:18596:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5231300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868958.230943:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.231241:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611200 00000100:00100000:3.0:1787868958.231251:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611200 00010000:00010000:3.0:1787868958.231290:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 9 pid: 18594 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.231330:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1787868958.231340:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:2403:x1874715918611200:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868958.231353:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868958.231372:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 9 pid: 18594 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.231385:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 9 pid: 18594 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.231420:0:17075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868958.231424:0:17075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787868958.231431:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.231440:0:17075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.231488:0:17075:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.231502:0:17075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17075:1874715939661824:192.168.204.27@tcp:105: 00000100:00100000:3.0:1787868958.231595:0:17075:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787868958.235977:0:17075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17075:1874715939661824:192.168.204.27@tcp:105: 00010000:00010000:3.0:1787868958.236097:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868958.236278:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:2403:x1874715918611200:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 4938us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.236290:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00010000:00010000:2.0:1787868958.238323:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4fb expref: 8 pid: 18594 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.238345:0:18596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18596:1874715939661696:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787868958.238378:0:18596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 7 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.238422:0:18596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d800, rc 0) 00000100:00100000:2.0:1787868958.238478:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15712:x1874715918611072:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 13684us (14010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.238488:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1787868958.242355:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868958.242439:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611328 00000100:00100000:1.0:1787868958.242449:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611328 00000100:00100000:1.0:1787868958.242504:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1787868958.242513:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2403:x1874715918611328:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787868958.242675:0:18597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787868958.242699:0:18597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787868957 00002000:00010000:1.0:1787868958.242702:0:18597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787868955 00002000:00010000:1.0:1787868958.242704:0:18597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787868957 -> 1787868957 00002000:00010000:1.0:1787868958.242707:0:18597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787868958.243780:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+8:2403:x1874715918611328:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 1263us (1428us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787868958.243791:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1787868958.248346:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.248500:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611456 00000100:00100000:0.0:1787868958.248510:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611456 00000100:00100000:0.0:1787868958.248782:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1787868958.248793:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+8:2403:x1874715918611456:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787868958.248836:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.249300:0:19034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 8 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.249312:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787868958.249316:0:19034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787868958.249321:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.249358:0:19034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 8 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.249373:0:19034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 8 pid: 18596 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.249460:0:19034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19034:1874715939661952:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787868958.249647:0:19034:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868958.257300:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.257394:0:19034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19034:1874715939661952:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787868958.257431:0:19034:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.257552:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611584 00000100:00100000:3.0:1787868958.257560:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611584 00010000:00010000:3.0:1787868958.257607:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.257645:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1787868958.257655:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+9:2403:x1874715918611584:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868958.257669:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868958.257699:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.257730:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.257754:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000523aabf7/0x2f11f4d3bde2e9b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff502 expref: 9 pid: 18596 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.257771:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868958.257775:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787868958.257781:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.257789:0:17073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.257823:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868958.258332:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+8:2403:x1874715918611584:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 676us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.258341:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:1.0:1787868958.258547:0:19034:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258558:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258579:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258601:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258610:0:19034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258617:0:19034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787868958.258622:0:19034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258644:0:19034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258658:0:19034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.258667:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f70396d7/0x2f11f4d3bde2e9bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.258743:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:2403:x1874715918611456:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 9952us (10408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868958.258751:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1787868958.262957:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.263207:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611840 00000100:00100000:3.0:1787868958.263219:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611840 00000100:00100000:3.0:1787868958.263275:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1787868958.263286:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:15712:x1874715918611840:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787868958.263364:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.263397:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.263415:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.263449:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.263461:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 15 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.263474:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662080:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787868958.263552:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787868958.266844:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662080:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868958.266882:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.268793:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.269350:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918611968 00000100:00100000:3.0:1787868958.269359:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918611968 00010000:00010000:3.0:1787868958.269396:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.269439:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787868958.269449:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+16:2403:x1874715918611968:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868958.269465:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868958.269486:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269499:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269523:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e895 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4a0 expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269550:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:3.0:1787868958.269556:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269566:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269573:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269581:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.269621:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868958.269669:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:2403:x1874715918611968:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 222us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.269678:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:1.0:1787868958.269730:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.269739:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.269951:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.269963:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.269972:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.270015:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.270027:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 15 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787868958.270040:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662208:192.168.204.27@tcp:104: 00000100:00100000:1.0:1787868958.270098:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787868958.275806:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.275889:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7009e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662208:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787868958.275918:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.276020:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612096 00000100:00100000:0.0:1787868958.276029:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612096 00010000:00010000:0.0:1787868958.276091:0:18622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.276134:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1787868958.276182:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+16:2404:x1874715918612096:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868958.276201:0:18622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868958.276209:0:18622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276223:0:18622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276250:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2e991 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4ed expref: 16 pid: 17090 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276270:0:18622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:0.0:1787868958.276283:0:18622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276294:0:18622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276303:0:18622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.276327:0:18622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868958.276388:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+15:2404:x1874715918612096:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 235us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.276396:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00010000:00010000:1.0:1787868958.276731:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868958.276739:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787868958.276848:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787868958.276957:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787868958.276992:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787868958.277091:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17088:1874715939662336:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787868958.277134:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868958.277195:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787868958.278973:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939662336 00000100:00100000:0.0:1787868958.278984:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939662336 00000100:00100000:0.0:1787868958.279041:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787868958.279050:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17088:x1874715939662336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787868958.279212:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17088:x1874715939662336:12345-0@lo:1000:mdt00_000.0 Request processed in 163us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.279220:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787868958.279355:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7008780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17088:1874715939662336:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787868958.279548:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787868958.279623:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17088:1874715939662464:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787868958.279659:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868958.279684:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da8311c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787868958.279992:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939662464 00000100:00100000:1.0:1787868958.279997:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939662464 00000100:00100000:1.0:1787868958.280023:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787868958.280029:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17088:x1874715939662464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787868958.280846:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17088:x1874715939662464:12345-0@lo:1000:mdt00_000.0 Request processed in 813us (1183us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787868958.280881:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787868958.282329:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17088:1874715939662464:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787868958.282493:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282505:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282513:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282519:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1be00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.282523:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282614:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282631:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:0.0:1787868958.282634:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787868958.282639:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282646:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2e9c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282677:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282741:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282748:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282753:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.282756:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282762:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282771:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.282773:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787868958.282780:0:17088:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282809:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.282818:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.283503:0:17088:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868958.283519:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662592:192.168.204.27@tcp:105: 00000100:00100000:0.0:1787868958.283718:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab52a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787868958.292061:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.292285:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f0e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17088:1874715939662592:192.168.204.27@tcp:105: 00010000:00010000:0.0:1787868958.292311:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292321:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e921 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292356:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292371:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292383:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292394:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292475:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292481:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292487:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.292491:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292498:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292510:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.292513:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787868958.292517:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292522:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1c800/0x2f11f4d3bde2e9d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292604:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292611:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292617:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292622:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787868958.292630:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292637:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292645:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:0.0:1787868958.292648:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787868958.292651:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868958.292657:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2e9c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787868958.292944:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612224 00000100:00100000:3.0:1787868958.292951:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612224 00000100:00100000:3.0:1787868958.293007:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1787868958.293017:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+19:15711:x1874715918612224:12345-192.168.204.27@tcp:49:bash.0 00000040:00080000:2.0:1787868958.293383:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787868958.293388:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787868958.293426:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787868958.293433:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787868958.293621:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+19:15712:x1874715918611840:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 30335us (30669us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787868958.293630:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000020:00080000:0.0:1787868958.293635:0:17088:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787868958.298220:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+18:15711:x1874715918612224:12345-192.168.204.27@tcp:49:bash.0 Request processed in 5194us (6158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.298233:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1787868958.298561:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.298687:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612480 00000100:00100000:3.0:1787868958.298696:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612480 00000100:00100000:3.0:1787868958.298732:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787868958.298740:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+18:15712:x1874715918612480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787868958.298981:0:17092:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787868958.299006:0:17092:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1787868958.299033:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299049:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299076:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299096:0:17092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299103:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299109:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.299126:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787868958.303199:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+20:15712:x1874715918612480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 4446us (4626us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1787868958.303214:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000020:00080000:3.0:1787868958.303221:0:17092:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787868958.303256:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868958.303264:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.303273:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787868958.303278:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.303287:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.303303:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:3.0:1787868958.303306:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787868958.303324:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.303331:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2e9d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868958.303344:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868958.303346:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868958.303348:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868958.310832:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.311536:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612608 00000100:00100000:2.0:1787868958.311547:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612608 00000100:00100000:2.0:1787868958.311616:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:2.0:1787868958.311627:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+7:15711:x1874715918612608:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868958.311648:0:18594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.311669:0:18594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff509 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787868958.311708:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a90b71d, atime: 0x6a90b71b, ctime: 0x6a90b71d, blocks: 0x0 00010000:00010000:2.0:1787868958.311731:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787868958.311735:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787868958.311746:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff509 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.311762:0:18594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff509 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.311791:0:18594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828da00, rc 0) 00000100:00100000:2.0:1787868958.312219:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+8:15711:x1874715918612608:12345-192.168.204.27@tcp:101:bash.0 Request processed in 516us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.312227:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:1.0:1787868958.319479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.319559:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612736 00000100:00100000:2.0:1787868958.319569:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612736 00000100:00100000:2.0:1787868958.319634:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:2.0:1787868958.319644:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+20:15711:x1874715918612736:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1787868958.319666:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.319685:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e9e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff510 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319729:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e9ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319743:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319755:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319869:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2e9e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff510 expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319888:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff510 expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.319909:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.319912:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868958.319916:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ce00, rc 0) 00000100:00100000:2.0:1787868958.319978:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15711:x1874715918612736:12345-192.168.204.27@tcp:101:bash.0 Request processed in 335us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.319985:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1787868958.324537:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.324891:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918612992 00000100:00100000:3.0:1787868958.324902:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918612992 00000100:00100000:3.0:1787868958.324964:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787868958.324975:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+21:15711:x1874715918612992:12345-192.168.204.27@tcp:35:bash.0 00000001:00080000:3.0:1787868958.325554:0:17092:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787868958.325649:0:17092:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787868958.325801:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+24:15711:x1874715918612992:12345-192.168.204.27@tcp:35:bash.0 Request processed in 826us (1280us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787868958.325809:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000020:00080000:3.0:1787868958.325813:0:17092:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787868958.449696:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.449736:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.449767:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.449808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868958.449835:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613120 00000100:00100000:3.0:1787868958.449844:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613120 00000100:00100000:3.0:1787868958.449896:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787868958.449906:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+13:2404:x1874715918613120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868958.449970:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+13:2404:x1874715918613120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868958.449993:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787868958.450044:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.450336:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613248 00000100:00100000:2.0:1787868958.450341:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613248 00000100:00080000:2.0:1787868958.450364:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787868958.450390:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613504 00000100:00100000:2.0:1787868958.450393:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613504 00000100:00080000:2.0:1787868958.450406:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868958.450422:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1787868958.450429:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918613248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868958.451373:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613760 00000100:00100000:1.0:1787868958.451381:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613760 00000100:00100000:1.0:1787868958.451452:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613376 00000100:00100000:1.0:1787868958.451456:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613376 00000100:00100000:1.0:1787868958.451483:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1787868958.451491:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1787868958.452889:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868958.452897:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868958.452938:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1787868958.452954:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918613376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868958.459274:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918613248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 8831us (9586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.459289:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1787868958.459328:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1787868958.459343:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918613504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868958.459393:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918613504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (9657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.459411:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1787868958.472014:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.472109:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.472355:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787868958.472366:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787868958.472394:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613632 00000100:00100000:2.0:1787868958.472411:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613632 00000100:00100000:2.0:1787868958.472482:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1787868958.472493:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868958.472595:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 105us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.472604:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00080000:2.0:1787868958.472642:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787868958.482319:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918613888 00000100:00100000:0.0:1787868958.482334:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918613888 00000100:00100000:0.0:1787868958.482427:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787868958.482447:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1787868958.482459:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868958.482543:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98824da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 86us (10433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868958.482550:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00080000:0.0:1787868958.482604:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787868958.485596:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918613760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 34024us (35746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868958.485615:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1787868958.489675:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918613376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36715us (39616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.489691:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1787868958.504254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.504327:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614144 00000100:00100000:2.0:1787868958.504338:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614144 00000100:00100000:2.0:1787868958.504401:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:2.0:1787868958.504413:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+24:15723:x1874715918614144:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787868958.504437:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787868958.504456:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e9f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff517 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787868958.504574:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787868958.504700:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e9f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff517 expref: 26 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.504716:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:2.0:1787868958.504719:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787868958.504725:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2e9f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff517 expref: 26 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.504763:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828cc00, rc 0) 00000100:00100000:2.0:1787868958.504831:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15723:x1874715918614144:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 419us (587us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787868958.504837:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:3.0:1787868958.509772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868958.509852:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614272 00000100:00100000:2.0:1787868958.509862:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614272 00000100:00100000:2.0:1787868958.509923:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:2.0:1787868958.509941:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15723:x1874715918614272:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1787868958.510022:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510038:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510049:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510063:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510069:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510074:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510211:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510237:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510244:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787868958.510288:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510300:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510307:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510312:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510317:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868958.510321:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510328:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510339:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868958.510341:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868958.510345:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510350:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d800/0x2f11f4d3bde2ea01 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510368:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510373:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510378:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510383:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c800 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868958.510386:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510392:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510399:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93dab5bab100) 00010000:00010000:2.0:1787868958.510401:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868958.510404:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510410:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c800/0x2f11f4d3bde2ea08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510425:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510432:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510437:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510448:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828cc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787868958.510451:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510457:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510465:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868958.510468:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868958.510471:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868958.510476:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828cc00/0x2f11f4d3bde2ea0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787868958.510541:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15723:x1874715918614272:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 602us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868958.510550:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:3.0:1787868958.514545:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868958.514641:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614528 00000100:00100000:0.0:1787868958.514650:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614528 00000100:00100000:0.0:1787868958.514712:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1787868958.514723:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+25:15723:x1874715918614528:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787868958.514958:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+26:15723:x1874715918614528:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 236us (422us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787868958.514969:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00010000:00010000:3.0:1787868958.625434:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868959.521675:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868959.521698:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939662720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868959.521764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868959.522079:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939662720 00000100:00100000:3.0:1787868959.522096:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939662720 00000100:00100000:3.0:1787868959.522188:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787868959.522199:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939662720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787868959.522228:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787868959.522274:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939662720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868959.522280:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787868959.522895:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939663232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.522930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.522950:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939663744:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.522970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.522984:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939664256:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523023:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787868959.523029:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939663104:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523066:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939663616:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523098:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939664128:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523146:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663232 00000100:00100000:1.0:1787868959.523150:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663232 00000100:00100000:1.0:1787868959.523194:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663744 00000100:00100000:1.0:1787868959.523197:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663744 00000100:00100000:1.0:1787868959.523207:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664256 00000100:00100000:1.0:1787868959.523209:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664256 00000100:00100000:1.0:1787868959.523221:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664128 00000100:00100000:1.0:1787868959.523223:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664128 00000100:00100000:1.0:1787868959.523236:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787868959.523243:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939663232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523280:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939663232:12345-0@lo:400:kworker.0 Request processed in 38us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523286:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787868959.523300:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787868959.523305:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939663744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523329:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939663744:12345-0@lo:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523335:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787868959.523345:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787868959.523350:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939664256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523373:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874715939664256:12345-0@lo:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523378:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787868959.523387:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787868959.523392:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939664128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523413:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939664128:12345-0@lo:400:kworker.0 Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523429:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787868959.523467:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939664128:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523479:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939663232:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523488:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939663744:0@lo:400:kworker.0 00010000:00080000:1.0:1787868959.523500:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888c0f00 x1874715939664256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868959.523510:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1874715939664256:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939662848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523617:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939663360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523658:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939663872:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523705:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787868959.523710:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939662976:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523741:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939663488:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523769:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939664000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868959.523809:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939662848 00000100:00100000:1.0:1787868959.523813:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939662848 00000100:00100000:1.0:1787868959.523848:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787868959.523854:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939662848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523886:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939662848:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523892:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787868959.523916:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663360 00000100:00100000:1.0:1787868959.523919:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663360 00000100:00100000:1.0:1787868959.523934:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939662976 00000100:00100000:1.0:1787868959.523936:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939662976 00000100:00100000:1.0:1787868959.523947:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787868959.523952:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939663360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.523983:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939663360:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.523988:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787868959.523999:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787868959.524005:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939662976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524030:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7008b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939662976:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.524035:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787868959.524071:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939662720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868959.524095:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939662976:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524104:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939662848:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524112:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939663360:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524129:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663872 00000100:00100000:1.0:1787868959.524132:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663872 00000100:00100000:1.0:1787868959.524178:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664000 00000100:00100000:1.0:1787868959.524182:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664000 00000100:00100000:1.0:1787868959.524197:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868959.524203:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939663872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524237:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939663872:12345-0@lo:400:kworker.0 Request processed in 34us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.524242:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787868959.524252:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868959.524258:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939664000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524281:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939664000:12345-0@lo:400:kworker.0 Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868959.524287:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787868959.524307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888c3480 x1874715939664000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868959.524317:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939664000:0@lo:400:kworker.0 00000100:00100000:1.0:1787868959.524325:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939663872:0@lo:400:kworker.0 00000100:00080000:0.0:1787868959.524516:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868959.524520:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868959.524523:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868959.524537:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663104 00000100:00100000:0.0:1787868959.524541:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663104 00000100:00100000:0.0:1787868959.524582:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663616 00000100:00100000:0.0:1787868959.524585:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663616 00000100:00100000:0.0:1787868959.524608:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939663488 00000100:00100000:0.0:1787868959.524611:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939663488 00000100:00100000:0.0:1787868959.524627:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868959.524634:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939663104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.524684:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab70092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939663104:12345-0@lo:400:kworker.0 Request processed in 51us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868959.524690:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868959.524702:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868959.524708:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939663616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.524745:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939663616:12345-0@lo:400:kworker.0 Request processed in 38us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868959.524751:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868959.524761:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868959.524767:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939663488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.524794:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939663488:12345-0@lo:400:kworker.0 Request processed in 28us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868959.524800:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787868959.524817:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868959.524820:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868959.524836:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939663488:0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.524856:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939663104:0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.524865:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939663616:0@lo:400:kworker.0 00000100:00100000:0.0:1787868959.528409:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868959.528431:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939664384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868959.528497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868959.528542:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664384 00000100:00100000:0.0:1787868959.528549:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664384 00000100:00100000:0.0:1787868959.528607:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868959.528616:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939664384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787868959.528637:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787868959.529218:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939664384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 602us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868959.529227:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787868959.529280:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab700cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939664384:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787868959.649383:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787868960.433808:0:20266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787868960.674350:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868961.569784:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868961.569810:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939664512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787868961.569883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868961.570014:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787868961.570024:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939664640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868961.570056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868961.570104:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664512 00000100:00100000:0.0:1787868961.570112:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664512 00000100:00100000:0.0:1787868961.570181:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664640 00000100:00100000:0.0:1787868961.570185:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664640 00000100:00100000:0.0:1787868961.570205:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868961.570215:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939664512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787868961.570245:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787868961.570288:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874715939664512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868961.570296:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787868961.570311:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868961.570317:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939664640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868961.570326:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787868961.570354:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939664640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868961.570359:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787868961.570395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939664640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868961.570429:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939664512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787868961.570488:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787868961.700609:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868962.016236:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868962.016320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868962.016418:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614656 00000100:00100000:3.0:1787868962.016429:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614656 00002000:00100000:3.0:1787868962.016501:0:18600:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff93d986f943c0 x1874715918614656/t0(0) o4->3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp:283/0 lens 504/0 e 0 to 0 dl 1787868973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787868962.016523:0:18600:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d986f943c0 with x1874715918614656 ext(0->8) 00002000:00010000:3.0:1787868962.016528:0:18600:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d986f943c0 00000100:00100000:3.0:1787868962.016563:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1787868962.016574:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+8:2403:x1874715918614656:12345-192.168.204.27@tcp:4:bash.0 00000100:00080000:0.0:1787868962.017492:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868962.017855:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614784 00000100:00100000:2.0:1787868962.017863:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614784 00000100:00100000:2.0:1787868962.017916:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868962.017925:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+11:2403:x1874715918614784:12345-192.168.204.27@tcp:16:kworker.0 00000100:00100000:2.0:1787868962.018683:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+11:2403:x1874715918614656:12345-192.168.204.27@tcp:4:bash.0 Request processed in 2108us (2359us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787868962.018698:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:2.0:1787868962.018715:0:18600:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff93d986f943c0 x1874715918614656/t8589934599(0) o4->3b83fde6-fad6-4b0f-a839-62ce511e8e7d@192.168.204.27@tcp:283/0 lens 504/448 e 0 to 0 dl 1787868973 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787868962.018726:0:18600:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93d986f943c0 with x1874715918614656 ext(0->8) 00002000:00010000:2.0:1787868962.018730:0:18600:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d986f943c0 00000001:00080000:2.0:1787868962.030758:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1787868962.030786:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:0.0:1787868962.031182:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab700fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2403:x1874715918614784:12345-192.168.204.27@tcp:16:kworker.0 Request processed in 13232us (14930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868962.031195:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000040:00080000:1.0:1787868962.407773:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787868962.407782:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787868962.407802:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787868962.407808:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787868962.593822:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868962.593853:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939664768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868962.594803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868962.594860:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939664896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868962.594906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868962.594988:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664768 00000100:00100000:1.0:1787868962.594995:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664768 00000100:00100000:1.0:1787868962.595043:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939664896 00000100:00100000:1.0:1787868962.595046:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939664896 00000100:00100000:1.0:1787868962.595063:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787868962.595073:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939664768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868962.595107:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787868962.595248:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939664768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868962.595254:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787868962.595275:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868962.595281:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939664896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868962.595297:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868962.595329:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939664896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868962.595335:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787868962.595374:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939664896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868962.595402:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939664768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787868962.723545:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43862 lines, 43862 kept, 0 dropped, 0 bad.